-- Logs begin at Tue 2022-08-30 13:59:44 UTC, end at Tue 2022-08-30 15:01:00 UTC. -- Aug 30 14:28:38.893742 dv-cinder-828805-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 14:28:38.901899 dv-cinder-828805-5-smb devstack@keystone.service[81712]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 14:28:38 2022] *** Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: nodename: dv-cinder-828805-5-smb Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: machine: x86_64 Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: clock source: unix Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: pcre jit disabled Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: detected number of CPU cores: 4 Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: current working directory: / Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: detected binary path: /usr/bin/uwsgi-core Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: your processes number limit is 47680 Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: your memory page size is 4096 bytes Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: detected max file descriptor number: 2048 Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: lock engine: pthread robust mutexes Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: thunder lock: enabled Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 14:28:38.906290 dv-cinder-828805-5-smb devstack@keystone.service[81712]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 14:28:38.945081 dv-cinder-828805-5-smb devstack@keystone.service[81712]: Python main interpreter initialized at 0x55e657cbc9c0 Aug 30 14:28:38.945081 dv-cinder-828805-5-smb devstack@keystone.service[81712]: python threads support enabled Aug 30 14:28:38.945081 dv-cinder-828805-5-smb devstack@keystone.service[81712]: your server socket listen backlog is limited to 100 connections Aug 30 14:28:38.945081 dv-cinder-828805-5-smb devstack@keystone.service[81712]: your mercy for graceful operations on workers is 90 seconds Aug 30 14:28:38.945520 dv-cinder-828805-5-smb devstack@keystone.service[81712]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 14:28:38.945520 dv-cinder-828805-5-smb devstack@keystone.service[81712]: *** Operational MODE: preforking *** Aug 30 14:28:38.945818 dv-cinder-828805-5-smb devstack@keystone.service[81712]: *** uWSGI is running in multiple interpreter mode *** Aug 30 14:28:38.945818 dv-cinder-828805-5-smb devstack@keystone.service[81712]: spawned uWSGI master process (pid: 81712) Aug 30 14:28:38.946041 dv-cinder-828805-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 14:28:38.948423 dv-cinder-828805-5-smb devstack@keystone.service[81712]: spawned uWSGI worker 1 (pid: 81722, cores: 1) Aug 30 14:28:38.948423 dv-cinder-828805-5-smb devstack@keystone.service[81712]: spawned uWSGI worker 2 (pid: 81723, cores: 1) Aug 30 14:28:38.948423 dv-cinder-828805-5-smb devstack@keystone.service[81712]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 14:28:43.253877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:28:43.253877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: from cryptography.utils import int_from_bytes Aug 30 14:28:43.254835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:28:43.254835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: from cryptography.utils import int_from_bytes Aug 30 14:28:43.254959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:28:43.254959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: from cryptography.utils import int_from_bytes Aug 30 14:28:43.254959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:28:43.254959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: from cryptography.utils import int_from_bytes Aug 30 14:28:43.303832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:28:43.304096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:28:43.304226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] command line args: [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:28:43.304445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:28:43.304628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ================================================================================ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:28:43.304821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] admin_token = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.304951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:28:43.305044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] config_dir = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.305130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:28:43.305207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.305369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] command line args: [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:28:43.305503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] config_source = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.305624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] debug = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.305744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:28:43.305866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.306156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ================================================================================ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:28:43.306156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] admin_token = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.306352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.306486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] config_dir = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.306610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.306721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.306821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.306924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] config_source = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] debug = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_config_append = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.307932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_dir = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_file = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_config_append = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.308834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.309039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.309141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_dir = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.309232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.309548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_file = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.310964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.311897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] publish_errors = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312384 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.312942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] publish_errors = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313117 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] standard_threads = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_journal = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.313910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_json = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.314044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.314114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_stderr = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.314114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] use_syslog = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.314227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] standard_threads = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.314309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.314709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.314866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.314973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.315073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.315173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.315173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_journal = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.315351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.315461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_json = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.315569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.315768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_stderr = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.315768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] use_syslog = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.316163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.316286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:28:43.316414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.316549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.316656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.316768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.316889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.316889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.317113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.317219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.317332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.317441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.317552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.317670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.317799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.317918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.318991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.319116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.319239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.319348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.319459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.319585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.319700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.319818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.320937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.321984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.322201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.322311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.322446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.322563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.322697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.322804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.322914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323816 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.323935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.324073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.324188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.324296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.324407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.324987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.325139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.325295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.325409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.325533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.325615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.325730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.325805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.325998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326265 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.326893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327202 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.327951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.328906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.329013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.329110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.329205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.329205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.329379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.329482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.329482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.330951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.331065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.331268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.331456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.331541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.331701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.331884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.331968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.332131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.332320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.332403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.332471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.332582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.332831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.332955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.333087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.333287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.333457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.333457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.333660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.333777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.333977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.334146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.334262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.334410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.334523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.334676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.334885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.335056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.335179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.335298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.335416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.335531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.335654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.335759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.336005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.336165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.336278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.336408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.336540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.336656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.336777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.336891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.337081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.337248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.337386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.337514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.337630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.337750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.337864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.337977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.338219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.338337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.338470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.338584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.338709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.external = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.338823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.338948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.339071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.339196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.339312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.339425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.339539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.password = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.339651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.339772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] auth.token = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.339997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.340182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.340182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.340621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.340780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.340934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.341084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.341227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.341368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.341510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.341654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.341816 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.341977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.341977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.342260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.342470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.342616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.342774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.342774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.343041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.343226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.343396 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.343542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.343656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.343771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.343771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.343992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.344106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.344220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.344332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.344445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.344566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.344566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.344803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.344924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.345970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.346085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.346198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.346198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.346430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.346545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.346672 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.346788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.346903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.347016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.347119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.347364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.347535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.347645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.347819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.347976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.348084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.348277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.348445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.348555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.348655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.348752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.348960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.349145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.external = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.349338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.349476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.349592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.349592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.349807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.349922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.350047 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.350162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.350275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.350441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.password = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.350561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.350712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] auth.token = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.350851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.350967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.351081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.351194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.351383 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.351555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.351697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.351817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.351932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.352048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.352164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.352287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.352404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.352518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.352642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.352756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.352969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.353153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.353153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.353385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.353501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.353615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.353738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.353949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.354065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.354182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.354297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.354436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.354553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.354680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.354796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.354979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.355098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.355214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.355327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.355453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.355568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.355682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.355926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.356097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.356294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.356492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.356492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.356847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.357926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.358048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.358162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.358276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.358468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.358587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.358735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.358867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.359932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.360045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.360258 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.360444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.360444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.360678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.360794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.360908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.361022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.361145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.361260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.361373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.361487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.361602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.361792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.361975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.362103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.362221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.362335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.362469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.362586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.362720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.362836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.362950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.363132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.363303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.363437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.363565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.363684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.363808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.363924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.364037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.364150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.364272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.364388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.364502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.364654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.364778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.364900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.365131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.365314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.365442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.365559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.365675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.365807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.365924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.366038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.366152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.366266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.366493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.366680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.366810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.366929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.367051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.367167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.367281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.367489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.367661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.367786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.367903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.368018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.368132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.368260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.368377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.368490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.368604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.368824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.368998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.369161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.369288 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.369405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.369520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.369634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.369749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.369873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.369991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.370095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.370195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.370451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] role.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.370605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.370732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] role.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.370837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.370934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.371110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.371354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.371616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.371783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.371982 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.372175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.372366 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.372562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.372690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.372819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.372944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.372944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.373205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.373321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.373435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.373559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.373675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.373796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.373796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.374021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.374137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.374259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.374400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.374541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.374660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.374773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.374888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.375016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.375131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.375246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.375465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.375636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.375761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.375890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.376008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.376123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.376240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.376379 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.376510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.376626 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.376740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.376854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.377058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.377235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.377377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.377499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.377615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.377729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.377844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.377957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.378079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.378195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.378364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.378531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.378660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.378776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.378899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.379089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.379248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.379357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.379530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.379686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.379885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.379990 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.380089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.380187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.380283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.380407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.380673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.380827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.380935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.381090 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.381225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.381326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.381507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.381616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.381790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.381917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.382022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.382235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.382352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.382520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.382730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.382836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.382995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.383099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.383233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.383450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.383558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.383681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.383824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.383929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.384123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.384236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.384337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.384540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.384645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.384798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.384964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.385056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.385251 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.385413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.385494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.385703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.385848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.385974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.386153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.386269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.386461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.386622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.386740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.386866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.387003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:28:43.387413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.387600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.387917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.388301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.388692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.389087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.389491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.389907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.390296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.390739 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.391106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.391492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.391882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.392277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.392673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.393085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.393483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.393867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.394262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.394690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.395105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.395517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.395905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.396321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.396735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.397126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.397526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.397918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.398311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.398723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] role.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.399130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] role.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.399511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.399922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.400351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.400655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.400962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.401263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.401563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.401852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.402148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.402481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.402913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.403383 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.403677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.403966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.404446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.404728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.405021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.405354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.405701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.406095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.406415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.406718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.407016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.407299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.407574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.408212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.408212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.408433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.408718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.409072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.409407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.409765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.410141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.410534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.410919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.411264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.411634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.413667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.413667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.413667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.413667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.413667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.413667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.413667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.415044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.415044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.415044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.415044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.415044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.415566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.415690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.415962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.416244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.416532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.416796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.416920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.417035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.417174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.417292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.417409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.417691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.417968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.418246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.418589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.418872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.419159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.419434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.419714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.419989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.420281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.420555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.420832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.421109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:28:43.421317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:28:43.425876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.447484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.447771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.448063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.454252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.454500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.457705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.476583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.476815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.509089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.515665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.558269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.558597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.562192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.562453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.726077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.726489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.726489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.726770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.726886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.727013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.727152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.727267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.727387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.727505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.727623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.727755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.752752 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.752975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.753113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.753240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.753363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.753513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.753640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.753759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.753878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.753997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.754126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.754240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.754363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.754507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.766152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.766443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.780681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.780929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.781104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.781319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.781533 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.781744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.781955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81723) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.784728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.784958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.785186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.785408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.785626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.785836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.786049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81722) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 14:28:43.799661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.799944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:28:43.800070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.800070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:28:43.800304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.800428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:28:43.800552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.800552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 14:28:43.800801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.800930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.801058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.801186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.801329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.801329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.801562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.801562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.811114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.811396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.811662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.811870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.811956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.812164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.812435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.812718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.819181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.819925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.822227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.822543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.822835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.822989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.823121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.823333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.823488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.823604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.823697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.823849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.823942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.824140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.824280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.824424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.824702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.824844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.824957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.825062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.825189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.825308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.825557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.825826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.848505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.849322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.849997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.850278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.850853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.851139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.854852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.855136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.855416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.856274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.856274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.856505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.862015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.862301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.863020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.863311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.866226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.866535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.866815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.867096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.867368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.867460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.867655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.867942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.868229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.868506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.868783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.869057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.869331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.869549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.869831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.870110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.885680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.885960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.886991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.887576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.889972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.891376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.893055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.893346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.894636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.894925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.897654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.899137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.900790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.902255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.903925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.904225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.904504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.904781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.905059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.905435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.905559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.905869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.906158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.906423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.906734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.907022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.921291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.921578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.921841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.922095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.922881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.923174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.923439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.923659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.928783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.930428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.930551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.931974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.932120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.932258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.933575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.933860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.934891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.935162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.935460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.935739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.936017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.936603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.936901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.937186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.937467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.937864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.947164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.947443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.947719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.947994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.948269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.948537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.948831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.949258 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.949546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.949877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.950168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.950579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.950876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.951171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.964630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.967024 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.967775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.969917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.970646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.972071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.972826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.973524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.973799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.974075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.974199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.975732 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.976018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.976416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.980571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.982199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.982859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.984330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.985055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.985354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.985634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.985909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.987214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.987620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.987912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.988191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.993755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.994039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.994316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.995999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:43.996290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:43.996597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.001204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81723) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:44.001507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.001760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.002034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.002298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.002608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.002878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.003147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.003421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.003564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81722) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 14:28:44.003648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.003793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.003932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.004070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.004149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.004332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.004458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.004591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.004691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81723) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.004864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.005134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.005409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.005687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.005961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.006225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.006543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.006809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.007086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81722) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 14:28:44.038620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e657cbc9c0 pid: 81723 (default app) Aug 30 14:28:44.041593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e657cbc9c0 pid: 81722 (default app) Aug 30 14:28:44.042408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aa9ef-35b4-4d06-bfff-85707560b78c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:44.042745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aa9ef-35b4-4d06-bfff-85707560b78c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:44.043055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aa9ef-35b4-4d06-bfff-85707560b78c None None] PATH_INFO: `/v3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:44.047559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Tue Aug 30 14:28:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:28:50.825730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aa296-3e15-4df3-884e-b02b2facbd8d None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:50.826403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aa296-3e15-4df3-884e-b02b2facbd8d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:50.826403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aa296-3e15-4df3-884e-b02b2facbd8d None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:50.833457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:28:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:28:50.839042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:50.839647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:50.839647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:50.910639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: INFO dbcounter [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] Registered counter for database keystone Aug 30 14:28:50.930559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG oslo_db.sqlalchemy.engines [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:28:50.938100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writer thread running {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:28:51.118699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG passlib.handlers.bcrypt [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81723) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 14:28:51.118962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG passlib.handlers.bcrypt [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81723) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 14:28:51.178709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:28:51.180311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:28:51.317438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:28:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 14:28:51.777463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aa296-3e15-4df3-884e-b02b2facbd8d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:51.846950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: INFO dbcounter [None req-c29aa296-3e15-4df3-884e-b02b2facbd8d None None] Registered counter for database keystone Aug 30 14:28:51.869445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG oslo_db.sqlalchemy.engines [None req-c29aa296-3e15-4df3-884e-b02b2facbd8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:28:51.877690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writer thread running {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:28:51.995885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aa296-3e15-4df3-884e-b02b2facbd8d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:52.000684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d295ec-92e4-45ca-ac34-0fbc13977bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:52.001298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d295ec-92e4-45ca-ac34-0fbc13977bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:52.001593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d295ec-92e4-45ca-ac34-0fbc13977bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:52.001859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d295ec-92e4-45ca-ac34-0fbc13977bb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:52.010323 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d295ec-92e4-45ca-ac34-0fbc13977bb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:52.061546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING keystone.common.rbac_enforcer.enforcer [None req-10d295ec-92e4-45ca-ac34-0fbc13977bb5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 14:28:52.061763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d295ec-92e4-45ca-ac34-0fbc13977bb5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:52.072215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Aug 30 14:28:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:28:52.078609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:52.093985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86f5d0-ed4d-4083-9551-9785b3e10d73 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:52.099698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab527d3-1724-4edb-8eac-70eee351a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:52.100834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab527d3-1724-4edb-8eac-70eee351a459 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:52.101108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab527d3-1724-4edb-8eac-70eee351a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:52.101378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab527d3-1724-4edb-8eac-70eee351a459 admin admin] PATH_INFO: `/v3/projects/259468708afd445bab53811821f0bda0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:52.103103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab527d3-1724-4edb-8eac-70eee351a459 admin admin] RBAC: Authorizing `identity:get_project(project_id=259468708afd445bab53811821f0bda0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:52.155347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ab527d3-1724-4edb-8eac-70eee351a459 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 14:28:52.155680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab527d3-1724-4edb-8eac-70eee351a459 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:52.160480 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Tue Aug 30 14:28:52 2022] GET /identity/v3/projects/259468708afd445bab53811821f0bda0 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:28:54.052546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43bae-58e9-4533-b293-9f73020dfded None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:54.053134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43bae-58e9-4533-b293-9f73020dfded None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:54.053134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43bae-58e9-4533-b293-9f73020dfded None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:54.057292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:28:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:28:54.063527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739f94-7b2d-434e-bcbb-0ff0cc528d9f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:54.063986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739f94-7b2d-434e-bcbb-0ff0cc528d9f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:54.064103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739f94-7b2d-434e-bcbb-0ff0cc528d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:54.085830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1b739f94-7b2d-434e-bcbb-0ff0cc528d9f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:28:54.087419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1b739f94-7b2d-434e-bcbb-0ff0cc528d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:28:54.096170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:28:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 14:28:54.357741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c43bae-58e9-4533-b293-9f73020dfded None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:54.371550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c43bae-58e9-4533-b293-9f73020dfded None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:54.376641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2fcff-dd05-43ba-91ea-8591afcff3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:54.377264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fcff-dd05-43ba-91ea-8591afcff3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:54.377543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fcff-dd05-43ba-91ea-8591afcff3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:54.377817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2fcff-dd05-43ba-91ea-8591afcff3b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:54.386301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2fcff-dd05-43ba-91ea-8591afcff3b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:54.388282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2fcff-dd05-43ba-91ea-8591afcff3b0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:54.397921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Aug 30 14:28:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:28:54.404447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b739f94-7b2d-434e-bcbb-0ff0cc528d9f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:54.414597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b739f94-7b2d-434e-bcbb-0ff0cc528d9f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:54.420382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adbb9b-30b6-4cfc-96dd-b5007f6c51f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:54.421049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adbb9b-30b6-4cfc-96dd-b5007f6c51f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:54.421321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adbb9b-30b6-4cfc-96dd-b5007f6c51f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:54.421582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adbb9b-30b6-4cfc-96dd-b5007f6c51f3 admin admin] PATH_INFO: `/v3/users/43c4bb62b38b4ecb87897eea003a764f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:54.423075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adbb9b-30b6-4cfc-96dd-b5007f6c51f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=43c4bb62b38b4ecb87897eea003a764f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:54.424953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adbb9b-30b6-4cfc-96dd-b5007f6c51f3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:54.426529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Tue Aug 30 14:28:54 2022] GET /identity/v3/users/43c4bb62b38b4ecb87897eea003a764f => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:28:56.429669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990626a6-2096-4eb2-ae4c-7619f600a079 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:56.430230 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990626a6-2096-4eb2-ae4c-7619f600a079 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:56.430731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990626a6-2096-4eb2-ae4c-7619f600a079 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:56.432477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:28:56.438933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84782b8b-e23a-4f9c-845e-926b47365c28 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:56.439524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84782b8b-e23a-4f9c-845e-926b47365c28 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:56.439524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84782b8b-e23a-4f9c-845e-926b47365c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:56.448121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021470d0-9634-4ba8-b206-10e7c04eda0d None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:56.448443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021470d0-9634-4ba8-b206-10e7c04eda0d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:56.448722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021470d0-9634-4ba8-b206-10e7c04eda0d None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:56.450302 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:28:56.457064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:56.457390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:56.457660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:56.464305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-84782b8b-e23a-4f9c-845e-926b47365c28 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:28:56.465799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-84782b8b-e23a-4f9c-845e-926b47365c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:28:56.504422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG passlib.handlers.bcrypt [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81722) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 14:28:56.504817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG passlib.handlers.bcrypt [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81722) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 14:28:56.553931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:28:56.555721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:28:56.560984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:28:56.666757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:28:56.834720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84782b8b-e23a-4f9c-845e-926b47365c28 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:56.861341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:28:56.933138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:56.954860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84782b8b-e23a-4f9c-845e-926b47365c28 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:56.993535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32535-e9b5-43ae-88a4-bf7cf52ea02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:56.994196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32535-e9b5-43ae-88a4-bf7cf52ea02a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:56.994504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32535-e9b5-43ae-88a4-bf7cf52ea02a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:56.994793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32535-e9b5-43ae-88a4-bf7cf52ea02a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:57.007562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec32535-e9b5-43ae-88a4-bf7cf52ea02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-3ec32535-e9b5-43ae-88a4-bf7cf52ea02a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:28:57.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:28:57.019295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:28:57.021304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:28:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:28:57.024752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32535-e9b5-43ae-88a4-bf7cf52ea02a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:57.079034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe72604-663b-4c15-86b6-31fe392a00c5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:57.082704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:28:57.130204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413b5b1-d27f-4812-9c81-d42e69852e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:57.131201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b5b1-d27f-4812-9c81-d42e69852e80 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:57.131377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:28:57.131508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b5b1-d27f-4812-9c81-d42e69852e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:57.131717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b5b1-d27f-4812-9c81-d42e69852e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:57.154212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32535-e9b5-43ae-88a4-bf7cf52ea02a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:57.196373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:57.196998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:57.197325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:57.197712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:57.198457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:28:57.198770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:57.201087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:57.217062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:28:57.217339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413b5b1-d27f-4812-9c81-d42e69852e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:57.218951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413b5b1-d27f-4812-9c81-d42e69852e80 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:57.223471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:57.334463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:28:57.340998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413b5b1-d27f-4812-9c81-d42e69852e80 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:57.344321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:28:57.353056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceeb09-eab5-4e6b-a746-33539f2afdbf None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:57.398078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30bdb2-40ef-475e-bf5f-0b6ee947fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:57.398774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30bdb2-40ef-475e-bf5f-0b6ee947fc4a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:57.399054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30bdb2-40ef-475e-bf5f-0b6ee947fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:57.399328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30bdb2-40ef-475e-bf5f-0b6ee947fc4a None admin] PATH_INFO: `/v3/users/43c4bb62b38b4ecb87897eea003a764f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:57.400584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30bdb2-40ef-475e-bf5f-0b6ee947fc4a None admin] RBAC: Authorizing `identity:get_user(user_id=43c4bb62b38b4ecb87897eea003a764f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:57.402136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30bdb2-40ef-475e-bf5f-0b6ee947fc4a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:57.404219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:28:57 2022] GET /identity/v3/users/43c4bb62b38b4ecb87897eea003a764f => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:28:57.413570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30bdb2-40ef-475e-bf5f-0b6ee947fc4a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:57.443102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:28:57.476994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413b5b1-d27f-4812-9c81-d42e69852e80 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:57.523341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:57.524462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:57.524923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:57.525289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:57.548359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:57.550091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:57.558855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30bdb2-40ef-475e-bf5f-0b6ee947fc4a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:28:57.573263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:28:57.574718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:28:57.575840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:28:57.575840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:28:57.575840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:28:57.575840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:28:57.582761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:57.608884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119b31-f712-41b2-924e-2526bbc11941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:57.609537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119b31-f712-41b2-924e-2526bbc11941 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:57.609813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119b31-f712-41b2-924e-2526bbc11941 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:57.610086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119b31-f712-41b2-924e-2526bbc11941 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:57.611318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b119b31-f712-41b2-924e-2526bbc11941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:57.612906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b119b31-f712-41b2-924e-2526bbc11941 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:57.614760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:28:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:28:57.620614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119b31-f712-41b2-924e-2526bbc11941 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:28:57.656591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:28:57.710253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:28:57.716955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735721cd-2868-4d50-ac7c-2fc262866ede None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:57.739060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119b31-f712-41b2-924e-2526bbc11941 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:28:57.772499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e4bc1-c257-430e-8cbf-1ceb939d0d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:57.773257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e4bc1-c257-430e-8cbf-1ceb939d0d99 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:57.773549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e4bc1-c257-430e-8cbf-1ceb939d0d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:57.773822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e4bc1-c257-430e-8cbf-1ceb939d0d99 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:57.774531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e4bc1-c257-430e-8cbf-1ceb939d0d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:28:57.774839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e4bc1-c257-430e-8cbf-1ceb939d0d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:57.776270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e4bc1-c257-430e-8cbf-1ceb939d0d99 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:57.786139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53420d5-b4b4-498e-87cc-505bc6b6912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:28:57.786784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53420d5-b4b4-498e-87cc-505bc6b6912e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:57.787055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53420d5-b4b4-498e-87cc-505bc6b6912e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:57.787319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53420d5-b4b4-498e-87cc-505bc6b6912e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:57.788043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53420d5-b4b4-498e-87cc-505bc6b6912e None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.domain.id=default, user.id=43c4bb62b38b4ecb87897eea003a764f) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:28:57.788342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53420d5-b4b4-498e-87cc-505bc6b6912e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:28:57.789789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53420d5-b4b4-498e-87cc-505bc6b6912e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:28:57.797663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Aug 30 14:28:57 2022] GET /identity/v3/role_assignments?user.id=43c4bb62b38b4ecb87897eea003a764f&scope.domain.id=default&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 233 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:28:57.800125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:28:59.909683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34697810-2f36-45b6-b71c-da111d0bb471 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:59.911349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34697810-2f36-45b6-b71c-da111d0bb471 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:59.912093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34697810-2f36-45b6-b71c-da111d0bb471 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:59.915306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:28:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:28:59.921491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a524d-49ea-4081-a392-831bebbfc448 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:28:59.922861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a524d-49ea-4081-a392-831bebbfc448 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:28:59.923607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a524d-49ea-4081-a392-831bebbfc448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:28:59.961568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c75a524d-49ea-4081-a392-831bebbfc448 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:28:59.964062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c75a524d-49ea-4081-a392-831bebbfc448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:00.102515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:00.456751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec635d0-9ee2-4fc5-a585-ed3513453e88 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:00.457691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec635d0-9ee2-4fc5-a585-ed3513453e88 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:00.458465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec635d0-9ee2-4fc5-a585-ed3513453e88 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:00.462340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:00.468355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbdb89-4720-40dc-80c9-38a8a0ee50d6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:00.469202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbdb89-4720-40dc-80c9-38a8a0ee50d6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:00.469939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbdb89-4720-40dc-80c9-38a8a0ee50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:00.509393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-bfdbdb89-4720-40dc-80c9-38a8a0ee50d6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:00.512702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bfdbdb89-4720-40dc-80c9-38a8a0ee50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:00.549782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bd2a-446b-41e3-b21e-cde633b2f495 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:00.551152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bd2a-446b-41e3-b21e-cde633b2f495 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:00.551895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bd2a-446b-41e3-b21e-cde633b2f495 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:00.555526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 14/25] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:00.562137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8a20a-cfae-48ed-af5f-d3ee1db5d8e9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:00.563177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8a20a-cfae-48ed-af5f-d3ee1db5d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:00.564159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8a20a-cfae-48ed-af5f-d3ee1db5d8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:00.630505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a7d8a20a-cfae-48ed-af5f-d3ee1db5d8e9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:00.633353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a7d8a20a-cfae-48ed-af5f-d3ee1db5d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:00.661515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:00.734161 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:00.769891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 15/27] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:00.777281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbdb89-4720-40dc-80c9-38a8a0ee50d6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:00.959941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbdb89-4720-40dc-80c9-38a8a0ee50d6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:00.966663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e03a-acc9-4382-baf6-e5c56c9399e1 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:00.967185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e03a-acc9-4382-baf6-e5c56c9399e1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:00.967185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e03a-acc9-4382-baf6-e5c56c9399e1 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:00.968747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 16/28] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:29:00.974218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6d3c-38cb-41af-85b6-ce191b9b5877 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:00.974518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6d3c-38cb-41af-85b6-ce191b9b5877 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:00.974812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc6d3c-38cb-41af-85b6-ce191b9b5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:01.012729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2696fc-fa9a-4e9c-be67-8830e5d1b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:01.013434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2696fc-fa9a-4e9c-be67-8830e5d1b86d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:01.013718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2696fc-fa9a-4e9c-be67-8830e5d1b86d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:01.014001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2696fc-fa9a-4e9c-be67-8830e5d1b86d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:01.015404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-46cc6d3c-38cb-41af-85b6-ce191b9b5877 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:01.016647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-46cc6d3c-38cb-41af-85b6-ce191b9b5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:01.035796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2696fc-fa9a-4e9c-be67-8830e5d1b86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-2f2696fc-fa9a-4e9c-be67-8830e5d1b86d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:01.043318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:01.044214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:01.044953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 13/29] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:01.050964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2696fc-fa9a-4e9c-be67-8830e5d1b86d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:01.126788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:01.174317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 17/30] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:01.218277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc6d3c-38cb-41af-85b6-ce191b9b5877 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:01.221975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:01.230972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2696fc-fa9a-4e9c-be67-8830e5d1b86d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:01.272464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:01.273032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:01.273449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:01.273728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:01.274450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:01.275070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:01.276791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:01.294623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 14/31] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:01.295312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:01.467655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc6d3c-38cb-41af-85b6-ce191b9b5877 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:01.518853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:01.521181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b70987-512d-4346-9277-628ae99d9fa2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:01.543101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d8ec-ad07-4c3f-8e44-b3f583570831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:01.543749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d8ec-ad07-4c3f-8e44-b3f583570831 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:01.544028 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d8ec-ad07-4c3f-8e44-b3f583570831 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:01.544294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d8ec-ad07-4c3f-8e44-b3f583570831 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:01.545012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631d8ec-ad07-4c3f-8e44-b3f583570831 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:01.546503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631d8ec-ad07-4c3f-8e44-b3f583570831 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:01.568704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f603c8-235b-495c-a3e5-1e0c672a7d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:01.569773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f603c8-235b-495c-a3e5-1e0c672a7d78 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:01.570338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f603c8-235b-495c-a3e5-1e0c672a7d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:01.570993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f603c8-235b-495c-a3e5-1e0c672a7d78 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:01.572248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f603c8-235b-495c-a3e5-1e0c672a7d78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:01.575148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f603c8-235b-495c-a3e5-1e0c672a7d78 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:01.686238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 18/32] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Aug 30 14:29:01 2022] POST /identity/v3/roles => generated 225 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:29:01.687360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d8ec-ad07-4c3f-8e44-b3f583570831 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:01.723172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 15/33] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Aug 30 14:29:01 2022] POST /identity/v3/roles => generated 219 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:01.724705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f603c8-235b-495c-a3e5-1e0c672a7d78 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:01.822933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:01.889345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d8ec-ad07-4c3f-8e44-b3f583570831 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:01.952001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4aa79-eba7-4941-b88b-943452e97194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:01.953102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4aa79-eba7-4941-b88b-943452e97194 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:01.953388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4aa79-eba7-4941-b88b-943452e97194 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:01.953666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4aa79-eba7-4941-b88b-943452e97194 None admin] PATH_INFO: `/v3/users/43c4bb62b38b4ecb87897eea003a764f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:01.956667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4aa79-eba7-4941-b88b-943452e97194 None admin] RBAC: Authorizing `identity:get_user(user_id=43c4bb62b38b4ecb87897eea003a764f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:01.958327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4aa79-eba7-4941-b88b-943452e97194 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:01.960066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 19/34] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:01 2022] GET /identity/v3/users/43c4bb62b38b4ecb87897eea003a764f => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:01.962413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22f76-e2f8-4be7-931b-0d38f46e234d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:01.962806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22f76-e2f8-4be7-931b-0d38f46e234d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:01.963091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22f76-e2f8-4be7-931b-0d38f46e234d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:01.964452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 20/35] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:01.970598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22f76-e2f8-4be7-931b-0d38f46e234d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:01.973201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f603c8-235b-495c-a3e5-1e0c672a7d78 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:02.034162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e65e1-ea63-4ed0-b363-1d7371c49ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:02.034898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e65e1-ea63-4ed0-b363-1d7371c49ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.035358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e65e1-ea63-4ed0-b363-1d7371c49ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.035644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e65e1-ea63-4ed0-b363-1d7371c49ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.048818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e65e1-ea63-4ed0-b363-1d7371c49ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:02.050476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e65e1-ea63-4ed0-b363-1d7371c49ff6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-9e4e65e1-ea63-4ed0-b363-1d7371c49ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:29:02.071651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:02.072609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:29:02.073484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:29:02.073484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:29:02.073484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:02.073484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 16/36] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:02.075410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe52e40-1d45-4691-a6af-83b89e4c6b4e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.075773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe52e40-1d45-4691-a6af-83b89e4c6b4e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.076124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe52e40-1d45-4691-a6af-83b89e4c6b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.096100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-efe52e40-1d45-4691-a6af-83b89e4c6b4e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:02.097638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-efe52e40-1d45-4691-a6af-83b89e4c6b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:02.102007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:02.116329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22f76-e2f8-4be7-931b-0d38f46e234d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:02.151706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:02.158400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb1d7c-7b8e-4264-8c45-c950a373097f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:02.159239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1d7c-7b8e-4264-8c45-c950a373097f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.159574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1d7c-7b8e-4264-8c45-c950a373097f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.159928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb1d7c-7b8e-4264-8c45-c950a373097f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.161284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb1d7c-7b8e-4264-8c45-c950a373097f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:02.163116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb1d7c-7b8e-4264-8c45-c950a373097f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:02.170169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 21/37] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:02.171165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb1d7c-7b8e-4264-8c45-c950a373097f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:02.177545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 17/38] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:02.178670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe52e40-1d45-4691-a6af-83b89e4c6b4e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:02.286687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb1d7c-7b8e-4264-8c45-c950a373097f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:02.308321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe52e40-1d45-4691-a6af-83b89e4c6b4e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:02.322225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd6f1e-3b90-4905-9149-3ed30afd8770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:02.323227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd6f1e-3b90-4905-9149-3ed30afd8770 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.323698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd6f1e-3b90-4905-9149-3ed30afd8770 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.323893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd6f1e-3b90-4905-9149-3ed30afd8770 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.324633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd6f1e-3b90-4905-9149-3ed30afd8770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:02.324902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd6f1e-3b90-4905-9149-3ed30afd8770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:02.326468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd6f1e-3b90-4905-9149-3ed30afd8770 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:02.345276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 22/39] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:02.346509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664142-75f7-4ce3-b566-eac6befa25be None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.346796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664142-75f7-4ce3-b566-eac6befa25be None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.347069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80664142-75f7-4ce3-b566-eac6befa25be None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.352306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 23/40] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:02.352306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664142-75f7-4ce3-b566-eac6befa25be None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:02.357179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b2618-312f-451a-b365-477713916a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:02.357868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b2618-312f-451a-b365-477713916a6b None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.358148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b2618-312f-451a-b365-477713916a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.358453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b2618-312f-451a-b365-477713916a6b None admin] PATH_INFO: `/v3/domains/default/users/43c4bb62b38b4ecb87897eea003a764f/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.360870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b2618-312f-451a-b365-477713916a6b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=43c4bb62b38b4ecb87897eea003a764f, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:02.362474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b2618-312f-451a-b365-477713916a6b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:02.375915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:02.386304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 18/41] 10.222.0.49 () {58 vars in 1361 bytes} [Tue Aug 30 14:29:02 2022] PUT /identity/v3/domains/default/users/43c4bb62b38b4ecb87897eea003a764f/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:02.386304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1ee3-3fc4-44b7-817b-5f6f40af52d4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.386304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1ee3-3fc4-44b7-817b-5f6f40af52d4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.386304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1ee3-3fc4-44b7-817b-5f6f40af52d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.409253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8ded1ee3-3fc4-44b7-817b-5f6f40af52d4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:02.411547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8ded1ee3-3fc4-44b7-817b-5f6f40af52d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:02.429372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:02.490842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80664142-75f7-4ce3-b566-eac6befa25be None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:02.508582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 19/42] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:02.509286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded1ee3-3fc4-44b7-817b-5f6f40af52d4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:02.551754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcb0bf-2131-4816-87e0-545ee5d9787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:02.552787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcb0bf-2131-4816-87e0-545ee5d9787f None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.553070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcb0bf-2131-4816-87e0-545ee5d9787f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.553426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcb0bf-2131-4816-87e0-545ee5d9787f None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.554093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcb0bf-2131-4816-87e0-545ee5d9787f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:02.556954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcb0bf-2131-4816-87e0-545ee5d9787f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:02.600923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 24/43] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:29:02 2022] POST /identity/v3/projects => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:29:02.655287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded1ee3-3fc4-44b7-817b-5f6f40af52d4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:02.694614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:02.703079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad64b4-1e51-42e9-8862-0d5bfcf6a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:02.704104 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad64b4-1e51-42e9-8862-0d5bfcf6a9c8 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:02.704809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad64b4-1e51-42e9-8862-0d5bfcf6a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:02.705093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad64b4-1e51-42e9-8862-0d5bfcf6a9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:02.705833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad64b4-1e51-42e9-8862-0d5bfcf6a9c8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:02.707505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad64b4-1e51-42e9-8862-0d5bfcf6a9c8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:02.727648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 20/44] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Aug 30 14:29:02 2022] POST /identity/v3/roles => generated 223 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:02.811100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcb0bf-2131-4816-87e0-545ee5d9787f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:02.977272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcb0bf-2131-4816-87e0-545ee5d9787f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:03.003782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:03.029570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19792449-b44e-4c30-badb-7ea371da103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:03.030225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792449-b44e-4c30-badb-7ea371da103b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:03.030534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792449-b44e-4c30-badb-7ea371da103b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:03.030806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19792449-b44e-4c30-badb-7ea371da103b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:03.031928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19792449-b44e-4c30-badb-7ea371da103b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:03.033416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19792449-b44e-4c30-badb-7ea371da103b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:03.035035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 25/45] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:03.040732 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad64b4-1e51-42e9-8862-0d5bfcf6a9c8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:03.148074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad64b4-1e51-42e9-8862-0d5bfcf6a9c8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:03.297661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b74b9a-63cf-4584-94f4-50749f1d1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:03.298289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b74b9a-63cf-4584-94f4-50749f1d1b85 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:03.298596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b74b9a-63cf-4584-94f4-50749f1d1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:03.298857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b74b9a-63cf-4584-94f4-50749f1d1b85 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:03.299524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b74b9a-63cf-4584-94f4-50749f1d1b85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:03.300995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b74b9a-63cf-4584-94f4-50749f1d1b85 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:03.333821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 21/46] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:29:03 2022] POST /identity/v3/projects => generated 312 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:04.442997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2fac4-b682-4ab0-aa52-f180547d439b None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:04.443550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2fac4-b682-4ab0-aa52-f180547d439b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:04.443550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2fac4-b682-4ab0-aa52-f180547d439b None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:04.444995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 26/47] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:04.452147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab0b2-2fec-4c2e-a512-3d334360c190 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:04.452757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab0b2-2fec-4c2e-a512-3d334360c190 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:04.452757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab0b2-2fec-4c2e-a512-3d334360c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:04.474694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-86dab0b2-2fec-4c2e-a512-3d334360c190 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:04.475968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-86dab0b2-2fec-4c2e-a512-3d334360c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:04.517679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:04.552134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 22/48] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:04.813515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2fac4-b682-4ab0-aa52-f180547d439b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:05.086123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2fac4-b682-4ab0-aa52-f180547d439b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:05.131817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb51a9-7077-4483-80de-d262a0c3bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:05.132492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb51a9-7077-4483-80de-d262a0c3bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.132776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb51a9-7077-4483-80de-d262a0c3bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.133056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb51a9-7077-4483-80de-d262a0c3bcd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.146699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb51a9-7077-4483-80de-d262a0c3bcd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d3cb51a9-7077-4483-80de-d262a0c3bcd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:05.151551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:05.152549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:05.153440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 27/49] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:05.159470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dab0b2-2fec-4c2e-a512-3d334360c190 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:05.278406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dab0b2-2fec-4c2e-a512-3d334360c190 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:05.298452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c48f8-2cfa-4b73-b2fe-b0d81a743426 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.298803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c48f8-2cfa-4b73-b2fe-b0d81a743426 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.299086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c48f8-2cfa-4b73-b2fe-b0d81a743426 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.300515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 28/50] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:05.306490 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8b92f-66ec-4934-870d-07dad676b1f7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.306774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8b92f-66ec-4934-870d-07dad676b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.307050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8b92f-66ec-4934-870d-07dad676b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.317925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:05.318606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.318893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.319171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.319856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:05.320168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:05.321607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:05.326815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-93b8b92f-66ec-4934-870d-07dad676b1f7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:05.328375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-93b8b92f-66ec-4934-870d-07dad676b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:05.331145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 23/51] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:05.337053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:05.365279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:05.373074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:05.404396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 29/52] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:05.448487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a9d7f-98dd-4ffa-9b8f-6637231be0b6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:05.483342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8188690-c5ca-411e-a463-72d820622d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:05.483989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8188690-c5ca-411e-a463-72d820622d52 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.484266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8188690-c5ca-411e-a463-72d820622d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.484543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8188690-c5ca-411e-a463-72d820622d52 None admin] PATH_INFO: `/v3/users/43c4bb62b38b4ecb87897eea003a764f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.485770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8188690-c5ca-411e-a463-72d820622d52 None admin] RBAC: Authorizing `identity:get_user(user_id=43c4bb62b38b4ecb87897eea003a764f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:05.487279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8188690-c5ca-411e-a463-72d820622d52 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:05.488911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 24/53] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:05 2022] GET /identity/v3/users/43c4bb62b38b4ecb87897eea003a764f => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:05.494915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8b92f-66ec-4934-870d-07dad676b1f7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:05.605684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8b92f-66ec-4934-870d-07dad676b1f7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:05.646518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde6f5-3be0-4d2f-b0cb-624ff862a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:05.647174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde6f5-3be0-4d2f-b0cb-624ff862a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.647515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde6f5-3be0-4d2f-b0cb-624ff862a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.647791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bde6f5-3be0-4d2f-b0cb-624ff862a6a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.648921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde6f5-3be0-4d2f-b0cb-624ff862a6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:05.650425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bde6f5-3be0-4d2f-b0cb-624ff862a6a7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:05.652043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 30/54] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:05.658121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8188690-c5ca-411e-a463-72d820622d52 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:05.667650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde6f5-3be0-4d2f-b0cb-624ff862a6a7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:05.710901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:05.761847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8188690-c5ca-411e-a463-72d820622d52 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:05.763524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:05.774107 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bde6f5-3be0-4d2f-b0cb-624ff862a6a7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:05.798072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:05.799123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.799615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.800107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.801407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.domain.id=default, user.id=43c4bb62b38b4ecb87897eea003a764f) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:05.801907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:05.803484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:05.810577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa041d-049c-4f38-8172-5e95627c0c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:05.811233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa041d-049c-4f38-8172-5e95627c0c52 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.811514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa041d-049c-4f38-8172-5e95627c0c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.811785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa041d-049c-4f38-8172-5e95627c0c52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.811926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 25/55] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Aug 30 14:29:05 2022] GET /identity/v3/role_assignments?user.id=43c4bb62b38b4ecb87897eea003a764f&scope.domain.id=default&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:05.813021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa041d-049c-4f38-8172-5e95627c0c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:05.814567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa041d-049c-4f38-8172-5e95627c0c52 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:05.816177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 31/56] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:05.822217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:05.941932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c412-f3fb-4662-bb4b-5172062f590c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:05.977845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278aba9-67fc-4da9-8bee-f079da9de1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:05.978521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278aba9-67fc-4da9-8bee-f079da9de1ce None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:05.978793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278aba9-67fc-4da9-8bee-f079da9de1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:05.979065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278aba9-67fc-4da9-8bee-f079da9de1ce None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:05.979730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278aba9-67fc-4da9-8bee-f079da9de1ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:05.981246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278aba9-67fc-4da9-8bee-f079da9de1ce None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:06.009164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 26/57] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Aug 30 14:29:05 2022] POST /identity/v3/projects => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:07.973736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0946f-32db-4668-bcb9-f4ab1440abbf None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:07.974310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0946f-32db-4668-bcb9-f4ab1440abbf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:07.974310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0946f-32db-4668-bcb9-f4ab1440abbf None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:07.975646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 32/58] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:07.981913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acdf71-19fe-4378-8977-8b9c584b25b9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:07.982481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acdf71-19fe-4378-8977-8b9c584b25b9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:07.982481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acdf71-19fe-4378-8977-8b9c584b25b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:08.003611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c3acdf71-19fe-4378-8977-8b9c584b25b9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:08.004889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c3acdf71-19fe-4378-8977-8b9c584b25b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:08.022489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:08.086370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 27/59] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:08.358079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0946f-32db-4668-bcb9-f4ab1440abbf None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:08.479455 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0946f-32db-4668-bcb9-f4ab1440abbf None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:08.487296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:08.515023 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922fab-ac58-4b08-be4d-9d4ed6a44a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:08.515666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922fab-ac58-4b08-be4d-9d4ed6a44a00 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:08.515954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922fab-ac58-4b08-be4d-9d4ed6a44a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:08.516225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922fab-ac58-4b08-be4d-9d4ed6a44a00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:08.517387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922fab-ac58-4b08-be4d-9d4ed6a44a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:08.518921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922fab-ac58-4b08-be4d-9d4ed6a44a00 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:08.520511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 33/60] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:08.526295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acdf71-19fe-4378-8977-8b9c584b25b9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:08.634045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acdf71-19fe-4378-8977-8b9c584b25b9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:08.672555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd792e3d-2fdc-456c-b92f-d8f9ef9414ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:08.673179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd792e3d-2fdc-456c-b92f-d8f9ef9414ad None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:08.673446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd792e3d-2fdc-456c-b92f-d8f9ef9414ad None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:08.673734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd792e3d-2fdc-456c-b92f-d8f9ef9414ad None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:08.674418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd792e3d-2fdc-456c-b92f-d8f9ef9414ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:08.675893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd792e3d-2fdc-456c-b92f-d8f9ef9414ad None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:08.703337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 28/61] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:29:08 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:11.664165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35713-94c1-4a6b-95be-fd122f506e09 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:11.664681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35713-94c1-4a6b-95be-fd122f506e09 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:11.664681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35713-94c1-4a6b-95be-fd122f506e09 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:11.666187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 34/62] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:11.671770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd359-b5a9-4350-9e82-7f0a9a1b16b4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:11.672193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd359-b5a9-4350-9e82-7f0a9a1b16b4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:11.672384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fd359-b5a9-4350-9e82-7f0a9a1b16b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:11.690470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:11.708109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5d1fd359-b5a9-4350-9e82-7f0a9a1b16b4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:11.709343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5d1fd359-b5a9-4350-9e82-7f0a9a1b16b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:11.792812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 29/63] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:11.826788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2c51-96ce-454c-b6e3-3c3afc4dfdde None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:11.827111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2c51-96ce-454c-b6e3-3c3afc4dfdde None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:11.827340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a2c51-96ce-454c-b6e3-3c3afc4dfdde None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:11.828706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 35/64] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:11.834595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079029dc-f00f-49cf-aa75-a914457e9614 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:11.834886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079029dc-f00f-49cf-aa75-a914457e9614 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:11.835162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079029dc-f00f-49cf-aa75-a914457e9614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:11.859867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-079029dc-f00f-49cf-aa75-a914457e9614 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:11.861063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-079029dc-f00f-49cf-aa75-a914457e9614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:11.946388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 30/65] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:12.153099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058aa34-2380-4b76-b472-24f2f5edbebc None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.153662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058aa34-2380-4b76-b472-24f2f5edbebc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.154073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058aa34-2380-4b76-b472-24f2f5edbebc None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.155620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 36/66] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:12.163627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679a83-013d-4f9c-8122-f8aa987a27f8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.163911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679a83-013d-4f9c-8122-f8aa987a27f8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.164185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679a83-013d-4f9c-8122-f8aa987a27f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.187863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058aa34-2380-4b76-b472-24f2f5edbebc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:12.192745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a7679a83-013d-4f9c-8122-f8aa987a27f8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:12.194228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a7679a83-013d-4f9c-8122-f8aa987a27f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:12.294627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:12.304458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 31/67] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:12.305935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe8b14-f491-4bbf-b74b-17670ffb8d4f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.306580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe8b14-f491-4bbf-b74b-17670ffb8d4f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.306998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe8b14-f491-4bbf-b74b-17670ffb8d4f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.308635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 32/68] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:12.329847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac3ed-052b-46e8-b478-3d49c6cad3f1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.330487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac3ed-052b-46e8-b478-3d49c6cad3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.330903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac3ed-052b-46e8-b478-3d49c6cad3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.358759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e00ac3ed-052b-46e8-b478-3d49c6cad3f1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:12.359976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e00ac3ed-052b-46e8-b478-3d49c6cad3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:12.365227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058aa34-2380-4b76-b472-24f2f5edbebc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:12.416066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ac626-b76b-4de3-883c-2f74d535b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:12.416192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac626-b76b-4de3-883c-2f74d535b519 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.416451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac626-b76b-4de3-883c-2f74d535b519 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.416661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac626-b76b-4de3-883c-2f74d535b519 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.433451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ac626-b76b-4de3-883c-2f74d535b519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-2f0ac626-b76b-4de3-883c-2f74d535b519 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:12.442400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:12.443698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:12.445103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:12.448687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 37/69] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:12.450229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ac626-b76b-4de3-883c-2f74d535b519 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:12.452651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 33/70] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:12.459521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ac3ed-052b-46e8-b478-3d49c6cad3f1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:12.494942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:12.589935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ac626-b76b-4de3-883c-2f74d535b519 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:12.625722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ae158-46cf-44e2-888e-a16ce45d901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:12.626396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ae158-46cf-44e2-888e-a16ce45d901e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.626681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ae158-46cf-44e2-888e-a16ce45d901e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.626954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ae158-46cf-44e2-888e-a16ce45d901e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.640025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ae158-46cf-44e2-888e-a16ce45d901e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-758ae158-46cf-44e2-888e-a16ce45d901e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:12.644878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:12.645730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 38/71] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:12.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5fd11-9a1c-4a28-9860-26abbfa541dd None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.653286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5fd11-9a1c-4a28-9860-26abbfa541dd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.653286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5fd11-9a1c-4a28-9860-26abbfa541dd None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.653399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ac3ed-052b-46e8-b478-3d49c6cad3f1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:12.653466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 39/72] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:12.655481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5fd11-9a1c-4a28-9860-26abbfa541dd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:12.677949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:12.689049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:12.689681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.689959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.690234 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.690937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:12.691242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:12.692641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:12.701383 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 34/73] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:12.702565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:12.782476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:12.794480 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5fd11-9a1c-4a28-9860-26abbfa541dd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:12.841556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623a3f-ded6-445b-aef2-bce55bb9406f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:12.845108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e6f6b-0a5d-4b6d-8457-c6c9fbcfa531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:12.845842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6f6b-0a5d-4b6d-8457-c6c9fbcfa531 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.846292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6f6b-0a5d-4b6d-8457-c6c9fbcfa531 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.846765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6f6b-0a5d-4b6d-8457-c6c9fbcfa531 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.861308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e6f6b-0a5d-4b6d-8457-c6c9fbcfa531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-bc5e6f6b-0a5d-4b6d-8457-c6c9fbcfa531 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:12.866192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:12.867065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 40/74] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:29:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:12.868582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c4449-167b-4869-8c38-f4fc2537e6f2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.869243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c4449-167b-4869-8c38-f4fc2537e6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.869243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c4449-167b-4869-8c38-f4fc2537e6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.882766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:12.883399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:12.883676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:12.883987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:12.884656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:12.884960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:12.886753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:12.888676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-487c4449-167b-4869-8c38-f4fc2537e6f2 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:12.889898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-487c4449-167b-4869-8c38-f4fc2537e6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:12.895643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 35/75] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:12.896501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:12.949429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:12.961698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 41/76] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:12.962589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c4449-167b-4869-8c38-f4fc2537e6f2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.017343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef17e1-7efb-4287-9ecc-892014829964 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.053826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ae49-f122-4150-9e1e-38344e69d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.054523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ae49-f122-4150-9e1e-38344e69d578 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.054791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:13.054892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ae49-f122-4150-9e1e-38344e69d578 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.055068 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ae49-f122-4150-9e1e-38344e69d578 None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.074091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ae49-f122-4150-9e1e-38344e69d578 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.075352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ae49-f122-4150-9e1e-38344e69d578 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.077341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 36/77] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:12 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:13.078015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ae49-f122-4150-9e1e-38344e69d578 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.082798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c4449-167b-4869-8c38-f4fc2537e6f2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.130044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cdfb4-c71a-4f7f-bbcc-7fdfe1296eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.132204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cdfb4-c71a-4f7f-bbcc-7fdfe1296eaf None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.132498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cdfb4-c71a-4f7f-bbcc-7fdfe1296eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.132774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cdfb4-c71a-4f7f-bbcc-7fdfe1296eaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.146675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cdfb4-c71a-4f7f-bbcc-7fdfe1296eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-395cdfb4-c71a-4f7f-bbcc-7fdfe1296eaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:13.151862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:13.152816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:13.153927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 42/78] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:13.155326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cdfb4-c71a-4f7f-bbcc-7fdfe1296eaf None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.210941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ae49-f122-4150-9e1e-38344e69d578 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.221236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:13.253082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.254029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.254500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.254830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.255591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:13.255900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.257311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.266003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 37/79] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:13.266888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.274832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cdfb4-c71a-4f7f-bbcc-7fdfe1296eaf None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.310765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1e1de-fa23-4b2e-91fa-23bf54a2ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.311409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1e1de-fa23-4b2e-91fa-23bf54a2ee49 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.311688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1e1de-fa23-4b2e-91fa-23bf54a2ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.312012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1e1de-fa23-4b2e-91fa-23bf54a2ee49 None admin] PATH_INFO: `/v3/users/43c4bb62b38b4ecb87897eea003a764f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.313175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1e1de-fa23-4b2e-91fa-23bf54a2ee49 None admin] RBAC: Authorizing `identity:get_user(user_id=43c4bb62b38b4ecb87897eea003a764f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.314752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1e1de-fa23-4b2e-91fa-23bf54a2ee49 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.316360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 43/80] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/users/43c4bb62b38b4ecb87897eea003a764f => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:13.317143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1e1de-fa23-4b2e-91fa-23bf54a2ee49 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.332614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:13.378408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec19df-aa56-4809-83fc-0723d11f6f8f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.417853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7469-1a8a-4181-9bff-a4f6021f0ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.418512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7469-1a8a-4181-9bff-a4f6021f0ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.418794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7469-1a8a-4181-9bff-a4f6021f0ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.419067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7469-1a8a-4181-9bff-a4f6021f0ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.432326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1e1de-fa23-4b2e-91fa-23bf54a2ee49 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.457752 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:13.467231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.467855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.468134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.468403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.469073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:13.469374 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.470870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.479700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 44/81] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:13.480555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.501478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed7469-1a8a-4181-9bff-a4f6021f0ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.503250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed7469-1a8a-4181-9bff-a4f6021f0ae5 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.559754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:13.591266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913786cc-74bf-4918-b5c5-59a6ece12ae0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.610783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 38/82] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:13.610783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7469-1a8a-4181-9bff-a4f6021f0ae5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.633392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f3a4d-30b2-48af-9b69-8f53d34b8e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.634049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3a4d-30b2-48af-9b69-8f53d34b8e2f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.634328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3a4d-30b2-48af-9b69-8f53d34b8e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.634635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3a4d-30b2-48af-9b69-8f53d34b8e2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.635834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f3a4d-30b2-48af-9b69-8f53d34b8e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.637699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f3a4d-30b2-48af-9b69-8f53d34b8e2f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.643231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 45/83] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:13.644149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f3a4d-30b2-48af-9b69-8f53d34b8e2f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.686713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:13.720322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7469-1a8a-4181-9bff-a4f6021f0ae5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.755291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62bc4f-b42e-401d-af3d-308761114225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.755647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f3a4d-30b2-48af-9b69-8f53d34b8e2f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.755928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62bc4f-b42e-401d-af3d-308761114225 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.756205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62bc4f-b42e-401d-af3d-308761114225 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.756473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62bc4f-b42e-401d-af3d-308761114225 None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.757627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62bc4f-b42e-401d-af3d-308761114225 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.759139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62bc4f-b42e-401d-af3d-308761114225 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.760774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 39/84] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:13.761802 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62bc4f-b42e-401d-af3d-308761114225 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.792680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c255-eb3b-44c5-99c6-7a9286e4e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.793288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c255-eb3b-44c5-99c6-7a9286e4e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.793698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c255-eb3b-44c5-99c6-7a9286e4e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.793830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c255-eb3b-44c5-99c6-7a9286e4e4c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.805948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:13.861659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62bc4f-b42e-401d-af3d-308761114225 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:13.872540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c255-eb3b-44c5-99c6-7a9286e4e4c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.874078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c255-eb3b-44c5-99c6-7a9286e4e4c3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.894431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada64c4-13fb-4501-8fd6-d1c1f57ae82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:13.895077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada64c4-13fb-4501-8fd6-d1c1f57ae82c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:13.895350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada64c4-13fb-4501-8fd6-d1c1f57ae82c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:13.895618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada64c4-13fb-4501-8fd6-d1c1f57ae82c None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:13.896729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada64c4-13fb-4501-8fd6-d1c1f57ae82c None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:13.898196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada64c4-13fb-4501-8fd6-d1c1f57ae82c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:13.899822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 40/85] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:13.900595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada64c4-13fb-4501-8fd6-d1c1f57ae82c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:13.904144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:13.978184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 46/86] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:13.979298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c255-eb3b-44c5-99c6-7a9286e4e4c3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:14.006095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada64c4-13fb-4501-8fd6-d1c1f57ae82c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:14.023486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:14.040152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77bf25-e693-488f-8917-4ec120ca9d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:14.040778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77bf25-e693-488f-8917-4ec120ca9d09 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:14.041065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77bf25-e693-488f-8917-4ec120ca9d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:14.041338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77bf25-e693-488f-8917-4ec120ca9d09 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:14.042517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77bf25-e693-488f-8917-4ec120ca9d09 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:14.044226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77bf25-e693-488f-8917-4ec120ca9d09 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:14.045893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 41/87] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:13 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:14.050938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77bf25-e693-488f-8917-4ec120ca9d09 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:14.081481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c255-eb3b-44c5-99c6-7a9286e4e4c3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:14.116186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f46dd-7d0b-47f1-b225-4a4b459eb3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:14.116835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f46dd-7d0b-47f1-b225-4a4b459eb3ce None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:14.117121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f46dd-7d0b-47f1-b225-4a4b459eb3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:14.117396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f46dd-7d0b-47f1-b225-4a4b459eb3ce None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:14.118061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f46dd-7d0b-47f1-b225-4a4b459eb3ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:14.119704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f46dd-7d0b-47f1-b225-4a4b459eb3ce None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:14.121804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:14.147954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 47/88] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:29:13 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:14.149075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f46dd-7d0b-47f1-b225-4a4b459eb3ce None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:14.152990 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77bf25-e693-488f-8917-4ec120ca9d09 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:14.194696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59202f-5053-4bba-bb8d-4f47c95dfe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:14.195387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59202f-5053-4bba-bb8d-4f47c95dfe58 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:14.195679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59202f-5053-4bba-bb8d-4f47c95dfe58 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:14.195950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59202f-5053-4bba-bb8d-4f47c95dfe58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:14.273632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59202f-5053-4bba-bb8d-4f47c95dfe58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:14.275116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59202f-5053-4bba-bb8d-4f47c95dfe58 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:14.279423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:14.284311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f46dd-7d0b-47f1-b225-4a4b459eb3ce None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:14.334652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450330b-8f25-4f9a-a74c-4cb700af49b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:14.335552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450330b-8f25-4f9a-a74c-4cb700af49b3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:14.335995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450330b-8f25-4f9a-a74c-4cb700af49b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:14.336429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450330b-8f25-4f9a-a74c-4cb700af49b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:14.362443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:14.402938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 42/89] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:14.403454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59202f-5053-4bba-bb8d-4f47c95dfe58 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:14.438042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450330b-8f25-4f9a-a74c-4cb700af49b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:14.439640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450330b-8f25-4f9a-a74c-4cb700af49b3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:14.536498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59202f-5053-4bba-bb8d-4f47c95dfe58 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:14.561454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:14.566209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 48/90] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:14.567124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450330b-8f25-4f9a-a74c-4cb700af49b3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:14.576125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940767-3c3f-40d3-acee-713a3e419ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:14.576958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940767-3c3f-40d3-acee-713a3e419ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:14.577244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940767-3c3f-40d3-acee-713a3e419ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:14.577569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8940767-3c3f-40d3-acee-713a3e419ef4 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:14.578805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8940767-3c3f-40d3-acee-713a3e419ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:14.580759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8940767-3c3f-40d3-acee-713a3e419ef4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:14.582785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 43/91] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:14 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:14.583358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940767-3c3f-40d3-acee-713a3e419ef4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:14.629871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:14.677491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450330b-8f25-4f9a-a74c-4cb700af49b3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:14.698818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8940767-3c3f-40d3-acee-713a3e419ef4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:14.716642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:14.717433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:14.717723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:14.717994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:14.719043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] RBAC: Adding query filter params (role.id=2284ec91b47444249d339c70801cd407, scope.project.id=1eda274b900241bf883d02a37e874f06, user.id=8c7c471adf5d45d9bc0f2ee644a28cad) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:14.719358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:14.720851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:14.728694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 49/92] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:14 2022] GET /identity/v3/role_assignments?user.id=8c7c471adf5d45d9bc0f2ee644a28cad&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=2284ec91b47444249d339c70801cd407 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:14.731256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:14.754843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090a14-de29-403a-9d67-3a8318b98839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:14.755531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090a14-de29-403a-9d67-3a8318b98839 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:14.755808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090a14-de29-403a-9d67-3a8318b98839 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:14.756083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090a14-de29-403a-9d67-3a8318b98839 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:14.759879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090a14-de29-403a-9d67-3a8318b98839 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:14.760496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090a14-de29-403a-9d67-3a8318b98839 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:14.762554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 44/93] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:14 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:14.764254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090a14-de29-403a-9d67-3a8318b98839 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:14.881431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:14.955494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5934a-39bd-450c-ac31-c5362017acbf None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:15.003117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090a14-de29-403a-9d67-3a8318b98839 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:15.022915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:15.040209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc819aa-8411-49f3-bc2d-068147e4c64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:15.042721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc819aa-8411-49f3-bc2d-068147e4c64b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:15.043205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc819aa-8411-49f3-bc2d-068147e4c64b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:15.044657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc819aa-8411-49f3-bc2d-068147e4c64b None admin] PATH_INFO: `/v3/projects/b8421dd156f746a39f2bb4aced9eb560` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:15.049408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc819aa-8411-49f3-bc2d-068147e4c64b None admin] RBAC: Authorizing `identity:get_project(project_id=b8421dd156f746a39f2bb4aced9eb560)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:15.051224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc819aa-8411-49f3-bc2d-068147e4c64b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:15.056959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 50/94] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:14 2022] GET /identity/v3/projects/b8421dd156f746a39f2bb4aced9eb560 => generated 312 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:15.062398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc819aa-8411-49f3-bc2d-068147e4c64b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:15.078655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:15.079987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:15.080454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:15.080907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:15.081824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=1eda274b900241bf883d02a37e874f06, user.id=43c4bb62b38b4ecb87897eea003a764f) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:15.082340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:15.084017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:15.090273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 45/95] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:14 2022] GET /identity/v3/role_assignments?user.id=43c4bb62b38b4ecb87897eea003a764f&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:15.091480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:15.202049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea0d57-7be1-4e26-a62d-f0fbd1f29ce6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:15.240195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd27a78-fc0d-4c58-8d21-efc5792243ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:15.241178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd27a78-fc0d-4c58-8d21-efc5792243ac None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:15.241646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd27a78-fc0d-4c58-8d21-efc5792243ac None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:15.242103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd27a78-fc0d-4c58-8d21-efc5792243ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:15.243089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd27a78-fc0d-4c58-8d21-efc5792243ac None admin] RBAC: Adding query filter params (role.id=2284ec91b47444249d339c70801cd407, scope.project.id=b8421dd156f746a39f2bb4aced9eb560, user.id=8c7c471adf5d45d9bc0f2ee644a28cad) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:15.243661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd27a78-fc0d-4c58-8d21-efc5792243ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:15.248648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd27a78-fc0d-4c58-8d21-efc5792243ac None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:15.255678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 46/96] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:15 2022] GET /identity/v3/role_assignments?user.id=8c7c471adf5d45d9bc0f2ee644a28cad&scope.project.id=b8421dd156f746a39f2bb4aced9eb560&role.id=2284ec91b47444249d339c70801cd407 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:15.336083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc819aa-8411-49f3-bc2d-068147e4c64b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:15.384094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:15.391428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb94e2-29d5-4945-815c-cf77310c7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:15.392495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb94e2-29d5-4945-815c-cf77310c7342 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:15.392776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb94e2-29d5-4945-815c-cf77310c7342 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:15.393211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb94e2-29d5-4945-815c-cf77310c7342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:15.393955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb94e2-29d5-4945-815c-cf77310c7342 None admin] RBAC: Adding query filter params (role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=1eda274b900241bf883d02a37e874f06, user.id=8c7c471adf5d45d9bc0f2ee644a28cad) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:15.394265 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb94e2-29d5-4945-815c-cf77310c7342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:15.395793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb94e2-29d5-4945-815c-cf77310c7342 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:15.402477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 51/97] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:15 2022] GET /identity/v3/role_assignments?user.id=8c7c471adf5d45d9bc0f2ee644a28cad&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:16.614856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1f423-e0e2-439c-8259-148c67113531 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:16.615369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1f423-e0e2-439c-8259-148c67113531 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:16.615369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1f423-e0e2-439c-8259-148c67113531 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:16.616798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 47/98] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:16.624038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e347-cec5-46a9-8dc3-38f2dfbed923 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:16.624643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e347-cec5-46a9-8dc3-38f2dfbed923 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:16.624643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e347-cec5-46a9-8dc3-38f2dfbed923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:16.655408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8e11e347-cec5-46a9-8dc3-38f2dfbed923 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:16.656627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8e11e347-cec5-46a9-8dc3-38f2dfbed923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:16.736873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 52/99] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:16.832808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddc93b-dc26-41f8-92e4-0b5bf3f18b5a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:16.833129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddc93b-dc26-41f8-92e4-0b5bf3f18b5a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:16.833361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddc93b-dc26-41f8-92e4-0b5bf3f18b5a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:16.834761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 48/100] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:16.840302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331049-158f-4d91-a0e9-9ade7d3f2b88 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:16.840597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331049-158f-4d91-a0e9-9ade7d3f2b88 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:16.840879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331049-158f-4d91-a0e9-9ade7d3f2b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:16.860051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-88331049-158f-4d91-a0e9-9ade7d3f2b88 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:16.861308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-88331049-158f-4d91-a0e9-9ade7d3f2b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:16.941975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 53/101] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:17.166276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddc93b-dc26-41f8-92e4-0b5bf3f18b5a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:17.205674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:17.294858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddc93b-dc26-41f8-92e4-0b5bf3f18b5a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:17.338722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae925-813b-4dab-974f-5a90963d48aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:17.339916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae925-813b-4dab-974f-5a90963d48aa None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:17.340438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae925-813b-4dab-974f-5a90963d48aa None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:17.340928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae925-813b-4dab-974f-5a90963d48aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:17.353131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aae925-813b-4dab-974f-5a90963d48aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b6aae925-813b-4dab-974f-5a90963d48aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:17.358718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:17.359595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:17.360441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:17.362848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 49/102] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:17.369180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331049-158f-4d91-a0e9-9ade7d3f2b88 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:17.469925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:17.485493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae925-813b-4dab-974f-5a90963d48aa None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:17.553361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331049-158f-4d91-a0e9-9ade7d3f2b88 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:17.627800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:17.635647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae925-813b-4dab-974f-5a90963d48aa None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:17.645673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875b3b6-fa91-4185-952a-a1df7c97f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:17.646311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b3b6-fa91-4185-952a-a1df7c97f5bf None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:17.646623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b3b6-fa91-4185-952a-a1df7c97f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:17.646900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b3b6-fa91-4185-952a-a1df7c97f5bf None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:17.647582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875b3b6-fa91-4185-952a-a1df7c97f5bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:17.647888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875b3b6-fa91-4185-952a-a1df7c97f5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:17.649314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875b3b6-fa91-4185-952a-a1df7c97f5bf None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:17.658974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 54/103] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:17.660335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b746-8b8d-4ec9-8d3f-6a4b74642e9f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:17.660632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b746-8b8d-4ec9-8d3f-6a4b74642e9f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:17.660908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b746-8b8d-4ec9-8d3f-6a4b74642e9f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:17.662259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 55/104] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:17.667270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b746-8b8d-4ec9-8d3f-6a4b74642e9f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:17.676459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47f0cd-42a9-4272-a1d0-667819be4436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:17.677120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f0cd-42a9-4272-a1d0-667819be4436 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:17.677406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f0cd-42a9-4272-a1d0-667819be4436 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:17.677682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f0cd-42a9-4272-a1d0-667819be4436 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:17.678956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47f0cd-42a9-4272-a1d0-667819be4436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:17.680447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47f0cd-42a9-4272-a1d0-667819be4436 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:17.682251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 50/105] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:17.686404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6efc4-94be-4d24-a955-43bd6f2346fd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:17.686404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6efc4-94be-4d24-a955-43bd6f2346fd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:17.686404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6efc4-94be-4d24-a955-43bd6f2346fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:17.704358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-bab6efc4-94be-4d24-a955-43bd6f2346fd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:17.705594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bab6efc4-94be-4d24-a955-43bd6f2346fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:17.808438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b746-8b8d-4ec9-8d3f-6a4b74642e9f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:17.814158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 51/106] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:17.815250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6efc4-94be-4d24-a955-43bd6f2346fd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:17.840459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:17.879640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83f665-2c62-4e57-9655-c59b6acb9b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:17.880332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f665-2c62-4e57-9655-c59b6acb9b19 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:17.880619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f665-2c62-4e57-9655-c59b6acb9b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:17.881004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f665-2c62-4e57-9655-c59b6acb9b19 None admin] PATH_INFO: `/v3/users/12409bd4a3a9446fa3706e66d9892110` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:17.907289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83f665-2c62-4e57-9655-c59b6acb9b19 None admin] RBAC: Authorizing `identity:get_user(user_id=12409bd4a3a9446fa3706e66d9892110)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:17.908923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83f665-2c62-4e57-9655-c59b6acb9b19 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:17.911121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 56/107] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:17 2022] GET /identity/v3/users/12409bd4a3a9446fa3706e66d9892110 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:17.915925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf4e16-8ab7-49dd-ac4b-6de8fcbd56b5 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:17.916218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf4e16-8ab7-49dd-ac4b-6de8fcbd56b5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:17.916498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf4e16-8ab7-49dd-ac4b-6de8fcbd56b5 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:17.917899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 57/108] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:17.920092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf4e16-8ab7-49dd-ac4b-6de8fcbd56b5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:17.930640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:17.934201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6efc4-94be-4d24-a955-43bd6f2346fd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:18.019175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb3699-fcfc-4da0-9b98-4fa7279b7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:18.019818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3699-fcfc-4da0-9b98-4fa7279b7087 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.020097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3699-fcfc-4da0-9b98-4fa7279b7087 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.020372 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb3699-fcfc-4da0-9b98-4fa7279b7087 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.021039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb3699-fcfc-4da0-9b98-4fa7279b7087 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:18.022609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb3699-fcfc-4da0-9b98-4fa7279b7087 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:18.075501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 52/109] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:29:17 2022] POST /identity/v3/projects => generated 302 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:18.082420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3af513-fb6e-41ec-9f72-29060a32f757 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.085656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3af513-fb6e-41ec-9f72-29060a32f757 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.086172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3af513-fb6e-41ec-9f72-29060a32f757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.110468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9b3af513-fb6e-41ec-9f72-29060a32f757 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:18.112025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9b3af513-fb6e-41ec-9f72-29060a32f757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:18.120358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf4e16-8ab7-49dd-ac4b-6de8fcbd56b5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:18.208008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce465d70-3ddc-4017-8b11-b884084587e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:18.208673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465d70-3ddc-4017-8b11-b884084587e1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.208957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465d70-3ddc-4017-8b11-b884084587e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.209233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465d70-3ddc-4017-8b11-b884084587e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.256149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 53/110] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:18.256887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3af513-fb6e-41ec-9f72-29060a32f757 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:18.325658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:18.377714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce465d70-3ddc-4017-8b11-b884084587e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:18.384087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce465d70-3ddc-4017-8b11-b884084587e1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:18.401975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:18.494259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3af513-fb6e-41ec-9f72-29060a32f757 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:18.521855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 58/111] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:18.523219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345607-23c3-4231-bb20-10eddc965cc2 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.523506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345607-23c3-4231-bb20-10eddc965cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.523780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345607-23c3-4231-bb20-10eddc965cc2 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.525322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 59/112] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:18.531694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345607-23c3-4231-bb20-10eddc965cc2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:18.550437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7a99c-9a5f-4cc9-b76f-5995b6eade3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:18.551173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7a99c-9a5f-4cc9-b76f-5995b6eade3c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.551456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7a99c-9a5f-4cc9-b76f-5995b6eade3c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.551730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7a99c-9a5f-4cc9-b76f-5995b6eade3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.564469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7a99c-9a5f-4cc9-b76f-5995b6eade3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-05f7a99c-9a5f-4cc9-b76f-5995b6eade3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:18.569792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:18.570674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:18.571955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 54/113] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:18.578361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f30b-c037-4e55-a5a2-d49ada251541 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.578643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f30b-c037-4e55-a5a2-d49ada251541 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.579284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f30b-c037-4e55-a5a2-d49ada251541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.598867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1614f30b-c037-4e55-a5a2-d49ada251541 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:18.600119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1614f30b-c037-4e55-a5a2-d49ada251541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:18.622240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:18.650765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345607-23c3-4231-bb20-10eddc965cc2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:18.689579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6868d19-9baa-4dd0-b399-3520568673f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:18.690245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868d19-9baa-4dd0-b399-3520568673f2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.690562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868d19-9baa-4dd0-b399-3520568673f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.690839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6868d19-9baa-4dd0-b399-3520568673f2 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.692010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6868d19-9baa-4dd0-b399-3520568673f2 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:18.693507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6868d19-9baa-4dd0-b399-3520568673f2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:18.695307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 60/114] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:18 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:18.696117 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6868d19-9baa-4dd0-b399-3520568673f2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:18.710097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 55/115] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:18.711090 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f30b-c037-4e55-a5a2-d49ada251541 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:18.793132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:18.827295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6868d19-9baa-4dd0-b399-3520568673f2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:18.846318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f30b-c037-4e55-a5a2-d49ada251541 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:18.872968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591318-21a3-4b93-a715-5e72514870df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:18.873603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591318-21a3-4b93-a715-5e72514870df None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.874168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591318-21a3-4b93-a715-5e72514870df None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.874481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591318-21a3-4b93-a715-5e72514870df None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.875637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25591318-21a3-4b93-a715-5e72514870df None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:18.876220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25591318-21a3-4b93-a715-5e72514870df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:18.878306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25591318-21a3-4b93-a715-5e72514870df None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:18.887241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8d34d-fd65-4479-986c-1724d6c7f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:18.888036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8d34d-fd65-4479-986c-1724d6c7f71e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.888392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8d34d-fd65-4479-986c-1724d6c7f71e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.888795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8d34d-fd65-4479-986c-1724d6c7f71e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.889227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 61/116] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:18.890494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591318-21a3-4b93-a715-5e72514870df None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:18.895064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:18.905855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8d34d-fd65-4479-986c-1724d6c7f71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-58b8d34d-fd65-4479-986c-1724d6c7f71e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:18.911146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:18.912027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:18.912791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 56/117] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:18.914131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d797-ebee-49a8-b276-5670fc55b2cd None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:18.914787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d797-ebee-49a8-b276-5670fc55b2cd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:18.915205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d797-ebee-49a8-b276-5670fc55b2cd None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:18.917186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 57/118] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:18.918779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89d797-ebee-49a8-b276-5670fc55b2cd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.022068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25591318-21a3-4b93-a715-5e72514870df None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.038295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89d797-ebee-49a8-b276-5670fc55b2cd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.063385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.064011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.064293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.064627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.065284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] RBAC: Adding query filter params (role.id=cdc99bb66fcc41f1a2b5ce626fa22557, scope.project.id=1eda274b900241bf883d02a37e874f06, user.id=12409bd4a3a9446fa3706e66d9892110) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:19.065593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:19.066408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:19.067317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:19.073949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 62/119] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:18 2022] GET /identity/v3/role_assignments?user.id=12409bd4a3a9446fa3706e66d9892110&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=cdc99bb66fcc41f1a2b5ce626fa22557 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:19.074844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.075863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533ea83-871b-43af-b072-a0ff6c779011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.076510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ea83-871b-43af-b072-a0ff6c779011 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.076790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ea83-871b-43af-b072-a0ff6c779011 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.077062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533ea83-871b-43af-b072-a0ff6c779011 None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.078221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533ea83-871b-43af-b072-a0ff6c779011 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:19.080128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533ea83-871b-43af-b072-a0ff6c779011 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:19.082076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 58/120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:18 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:19.083059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27d39-0aca-471d-be05-787c14819f51 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.083340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27d39-0aca-471d-be05-787c14819f51 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.083607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27d39-0aca-471d-be05-787c14819f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.104542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2ba27d39-0aca-471d-be05-787c14819f51 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:19.105760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2ba27d39-0aca-471d-be05-787c14819f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:19.175289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:19.182580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 59/121] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:19.189419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27d39-0aca-471d-be05-787c14819f51 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.224193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a39104-871e-4df2-982e-a668e0b0ff6c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.260508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.261545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.262024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.262529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.263440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:19.263951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:19.265646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:19.275559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 63/122] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:19.281608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.392908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6d37e-cbe5-4661-93bc-3b224c95c0d2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.445221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:19.450567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27d39-0aca-471d-be05-787c14819f51 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.456382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6e23-278f-4c95-9aac-7bc5d4f56df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.458888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6e23-278f-4c95-9aac-7bc5d4f56df9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.459175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6e23-278f-4c95-9aac-7bc5d4f56df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.459455 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6e23-278f-4c95-9aac-7bc5d4f56df9 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.462239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6e23-278f-4c95-9aac-7bc5d4f56df9 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:19.463833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d6e23-278f-4c95-9aac-7bc5d4f56df9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:19.465830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 64/123] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:19 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:19.467461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6e23-278f-4c95-9aac-7bc5d4f56df9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.507833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:19.522959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae28eb-b9cb-43c3-8cac-fd6621d0bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.523658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae28eb-b9cb-43c3-8cac-fd6621d0bbdc None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.523944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae28eb-b9cb-43c3-8cac-fd6621d0bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.524217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae28eb-b9cb-43c3-8cac-fd6621d0bbdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.543892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae28eb-b9cb-43c3-8cac-fd6621d0bbdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-fbae28eb-b9cb-43c3-8cac-fd6621d0bbdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:19.550324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:19.551185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:19.551921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:19.552478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 60/124] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:19.554861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae28eb-b9cb-43c3-8cac-fd6621d0bbdc None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.611564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6e23-278f-4c95-9aac-7bc5d4f56df9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.656586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d946dd-025e-4f89-a64d-34143d0def06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.657726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d946dd-025e-4f89-a64d-34143d0def06 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.658027 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d946dd-025e-4f89-a64d-34143d0def06 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.658308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d946dd-025e-4f89-a64d-34143d0def06 None admin] PATH_INFO: `/v3/users/43c4bb62b38b4ecb87897eea003a764f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.659852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d946dd-025e-4f89-a64d-34143d0def06 None admin] RBAC: Authorizing `identity:get_user(user_id=43c4bb62b38b4ecb87897eea003a764f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:19.661673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d946dd-025e-4f89-a64d-34143d0def06 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:19.663845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 65/125] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:19 2022] GET /identity/v3/users/43c4bb62b38b4ecb87897eea003a764f => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:19.667172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d946dd-025e-4f89-a64d-34143d0def06 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.691978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae28eb-b9cb-43c3-8cac-fd6621d0bbdc None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.736110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b438f-07aa-46ae-af9d-891aa68fbff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.736889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b438f-07aa-46ae-af9d-891aa68fbff8 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.737316 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b438f-07aa-46ae-af9d-891aa68fbff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.737601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b438f-07aa-46ae-af9d-891aa68fbff8 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06/users/8c7c471adf5d45d9bc0f2ee644a28cad/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.740314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b438f-07aa-46ae-af9d-891aa68fbff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eda274b900241bf883d02a37e874f06, user_id=8c7c471adf5d45d9bc0f2ee644a28cad, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:19.742156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b438f-07aa-46ae-af9d-891aa68fbff8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:19.753286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:19.762414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 61/126] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:19 2022] PUT /identity/v3/projects/1eda274b900241bf883d02a37e874f06/users/8c7c471adf5d45d9bc0f2ee644a28cad/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:19.763278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b438f-07aa-46ae-af9d-891aa68fbff8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.812373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d946dd-025e-4f89-a64d-34143d0def06 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.857880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:19.882254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c46c4-6199-40ab-816e-ad4e6631f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.883038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c46c4-6199-40ab-816e-ad4e6631f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.883332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c46c4-6199-40ab-816e-ad4e6631f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.883605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c46c4-6199-40ab-816e-ad4e6631f8c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.915134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c46c4-6199-40ab-816e-ad4e6631f8c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ed6c46c4-6199-40ab-816e-ad4e6631f8c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:19.921424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:19.922291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:19.923074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:19.925354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 66/127] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:29:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:19.926420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c46c4-6199-40ab-816e-ad4e6631f8c7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:19.941904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b438f-07aa-46ae-af9d-891aa68fbff8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:19.979780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:19.980491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:19.980774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:19.981115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:19.981796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:19.982102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:19.983617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:19.994611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 62/128] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:19.995885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:20.069428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c46c4-6199-40ab-816e-ad4e6631f8c7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:20.098937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:20.109086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ce2f1-dc67-47ce-b8b3-0887c55f3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:20.109748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce2f1-dc67-47ce-b8b3-0887c55f3e58 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.110032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce2f1-dc67-47ce-b8b3-0887c55f3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.110311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce2f1-dc67-47ce-b8b3-0887c55f3e58 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.111528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ce2f1-dc67-47ce-b8b3-0887c55f3e58 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:20.113100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ce2f1-dc67-47ce-b8b3-0887c55f3e58 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:20.118510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 67/129] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:19 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:20.119523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ce2f1-dc67-47ce-b8b3-0887c55f3e58 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:20.134829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f4f65-ac8d-4c76-b03d-9bc8934d969e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:20.150894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:20.225605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ce2f1-dc67-47ce-b8b3-0887c55f3e58 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:20.239145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:20.240155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.240631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.241098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.241993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:20.242530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:20.244145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:20.261123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e124-5fa5-45d1-b17c-f4bb83417c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:20.261810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e124-5fa5-45d1-b17c-f4bb83417c5c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.262094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e124-5fa5-45d1-b17c-f4bb83417c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.262368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e124-5fa5-45d1-b17c-f4bb83417c5c None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.263652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e124-5fa5-45d1-b17c-f4bb83417c5c None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:20.265214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e124-5fa5-45d1-b17c-f4bb83417c5c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:20.267206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 68/130] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:20 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:20.267866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e124-5fa5-45d1-b17c-f4bb83417c5c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:20.268133 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 63/131] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:29:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:20.273925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:20.358799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:20.378740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e124-5fa5-45d1-b17c-f4bb83417c5c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:20.415486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c021e9-ae0d-4ab8-9106-9a5a0e2b3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:20.416355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c021e9-ae0d-4ab8-9106-9a5a0e2b3dd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.416767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c021e9-ae0d-4ab8-9106-9a5a0e2b3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.417115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c021e9-ae0d-4ab8-9106-9a5a0e2b3dd5 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06/users/43c4bb62b38b4ecb87897eea003a764f/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.419520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c021e9-ae0d-4ab8-9106-9a5a0e2b3dd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eda274b900241bf883d02a37e874f06, user_id=43c4bb62b38b4ecb87897eea003a764f, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:20.421185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c021e9-ae0d-4ab8-9106-9a5a0e2b3dd5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:20.441393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 69/132] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:20 2022] PUT /identity/v3/projects/1eda274b900241bf883d02a37e874f06/users/43c4bb62b38b4ecb87897eea003a764f/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:20.446700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c021e9-ae0d-4ab8-9106-9a5a0e2b3dd5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:20.530926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0f4af-b9fa-4d0b-bd73-fd5034a120cc None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:20.633343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c021e9-ae0d-4ab8-9106-9a5a0e2b3dd5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:20.661031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:20.663113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad0428-56ed-4a9f-b864-d89f5463b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:20.663787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0428-56ed-4a9f-b864-d89f5463b0ba None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.664069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0428-56ed-4a9f-b864-d89f5463b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.664344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0428-56ed-4a9f-b864-d89f5463b0ba None admin] PATH_INFO: `/v3/projects/b8421dd156f746a39f2bb4aced9eb560` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.665524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad0428-56ed-4a9f-b864-d89f5463b0ba None admin] RBAC: Authorizing `identity:get_project(project_id=b8421dd156f746a39f2bb4aced9eb560)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:20.667026 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad0428-56ed-4a9f-b864-d89f5463b0ba None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:20.669704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 64/133] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:20 2022] GET /identity/v3/projects/b8421dd156f746a39f2bb4aced9eb560 => generated 312 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:20.670571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316137a-25be-4093-9fd4-55bfc88120be None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.670670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316137a-25be-4093-9fd4-55bfc88120be None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.670922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316137a-25be-4093-9fd4-55bfc88120be None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.672212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 65/134] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:20.677878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316137a-25be-4093-9fd4-55bfc88120be None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:20.689808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c8757-6aa9-4ec4-895f-92a3fdd0e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:20.690521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c8757-6aa9-4ec4-895f-92a3fdd0e905 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.690798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c8757-6aa9-4ec4-895f-92a3fdd0e905 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.691068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c8757-6aa9-4ec4-895f-92a3fdd0e905 None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.692215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c8757-6aa9-4ec4-895f-92a3fdd0e905 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:20.693697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c8757-6aa9-4ec4-895f-92a3fdd0e905 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:20.695628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 70/135] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:20 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:20.696755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4065bc6-a806-4f94-bf10-272b30dca246 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.697032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4065bc6-a806-4f94-bf10-272b30dca246 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.697303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4065bc6-a806-4f94-bf10-272b30dca246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.716512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f4065bc6-a806-4f94-bf10-272b30dca246 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:20.717671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f4065bc6-a806-4f94-bf10-272b30dca246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:20.731915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:20.804327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 71/136] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:20.805288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4065bc6-a806-4f94-bf10-272b30dca246 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:20.872308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316137a-25be-4093-9fd4-55bfc88120be None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:20.957715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4065bc6-a806-4f94-bf10-272b30dca246 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:20.980706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ff916-f71c-4069-800c-005638081f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:20.981662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ff916-f71c-4069-800c-005638081f3c None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:20.982077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ff916-f71c-4069-800c-005638081f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:20.982514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ff916-f71c-4069-800c-005638081f3c None admin] PATH_INFO: `/v3/projects/b8421dd156f746a39f2bb4aced9eb560/users/8c7c471adf5d45d9bc0f2ee644a28cad/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:20.984598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ff916-f71c-4069-800c-005638081f3c None admin] RBAC: Authorizing `identity:create_grant(project_id=b8421dd156f746a39f2bb4aced9eb560, user_id=8c7c471adf5d45d9bc0f2ee644a28cad, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:20.986242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ff916-f71c-4069-800c-005638081f3c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:20.992259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:21.013225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 66/137] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:20 2022] PUT /identity/v3/projects/b8421dd156f746a39f2bb4aced9eb560/users/8c7c471adf5d45d9bc0f2ee644a28cad/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:21.020313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a1e93-edad-4fed-b7ba-7f6841babd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:21.021058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1e93-edad-4fed-b7ba-7f6841babd65 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:21.021439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1e93-edad-4fed-b7ba-7f6841babd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:21.021713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a1e93-edad-4fed-b7ba-7f6841babd65 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:21.022923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a1e93-edad-4fed-b7ba-7f6841babd65 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:21.024515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a1e93-edad-4fed-b7ba-7f6841babd65 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:21.026578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 72/138] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:20 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:21.033093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ff916-f71c-4069-800c-005638081f3c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:21.144261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:21.150923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ff916-f71c-4069-800c-005638081f3c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:21.187709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b78d10-ce95-4daf-a337-bf7f6642032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:21.188797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b78d10-ce95-4daf-a337-bf7f6642032c None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:21.189289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b78d10-ce95-4daf-a337-bf7f6642032c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:21.190055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b78d10-ce95-4daf-a337-bf7f6642032c None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06/users/8c7c471adf5d45d9bc0f2ee644a28cad/roles/0ac8e76ee0884ae1be64093499d4865e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:21.192626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b78d10-ce95-4daf-a337-bf7f6642032c None admin] RBAC: Authorizing `identity:create_grant(project_id=1eda274b900241bf883d02a37e874f06, user_id=8c7c471adf5d45d9bc0f2ee644a28cad, role_id=0ac8e76ee0884ae1be64093499d4865e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:21.194411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b78d10-ce95-4daf-a337-bf7f6642032c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:21.209713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 67/139] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:21 2022] PUT /identity/v3/projects/1eda274b900241bf883d02a37e874f06/users/8c7c471adf5d45d9bc0f2ee644a28cad/roles/0ac8e76ee0884ae1be64093499d4865e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:21.234142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a1e93-edad-4fed-b7ba-7f6841babd65 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:21.383452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a1e93-edad-4fed-b7ba-7f6841babd65 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:21.437470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e84f96-f243-486f-b85c-52f263a28713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:21.438137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84f96-f243-486f-b85c-52f263a28713 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:21.438439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84f96-f243-486f-b85c-52f263a28713 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:21.438713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e84f96-f243-486f-b85c-52f263a28713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:21.439878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e84f96-f243-486f-b85c-52f263a28713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:21.441523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e84f96-f243-486f-b85c-52f263a28713 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:21.443144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 73/140] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:21.449261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b78d10-ce95-4daf-a337-bf7f6642032c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:21.475018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939d88-c149-4cbc-b104-f972ca259eff None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:21.475210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939d88-c149-4cbc-b104-f972ca259eff None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:21.475419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939d88-c149-4cbc-b104-f972ca259eff None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:21.477065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 74/141] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:29:21.484580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc03cd-147e-4e9c-90c8-eaacf9c72fe5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:21.484918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc03cd-147e-4e9c-90c8-eaacf9c72fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:21.485124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc03cd-147e-4e9c-90c8-eaacf9c72fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:21.512439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7fbc03cd-147e-4e9c-90c8-eaacf9c72fe5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:21.512766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7fbc03cd-147e-4e9c-90c8-eaacf9c72fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:21.570335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b78d10-ce95-4daf-a337-bf7f6642032c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:21.608941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0d01-cb74-42d5-b344-2b66cb1b4894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:21.610729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:21.611313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0d01-cb74-42d5-b344-2b66cb1b4894 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:21.611313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0d01-cb74-42d5-b344-2b66cb1b4894 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:21.611577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0d01-cb74-42d5-b344-2b66cb1b4894 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:21.612697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb0d01-cb74-42d5-b344-2b66cb1b4894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:21.615560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb0d01-cb74-42d5-b344-2b66cb1b4894 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:21.633408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 75/142] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 14:29:21.656159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 68/143] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:29:21 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:21.982064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc03cd-147e-4e9c-90c8-eaacf9c72fe5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:22.107234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc03cd-147e-4e9c-90c8-eaacf9c72fe5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:22.148482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c205af-9e8f-45db-805e-78fbe86e56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:22.149528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c205af-9e8f-45db-805e-78fbe86e56a5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:22.150007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c205af-9e8f-45db-805e-78fbe86e56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:22.150610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c205af-9e8f-45db-805e-78fbe86e56a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:22.167150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c205af-9e8f-45db-805e-78fbe86e56a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-60c205af-9e8f-45db-805e-78fbe86e56a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:22.172616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:22.173496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:22.174262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:22.176678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 76/144] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:22.182644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0d01-cb74-42d5-b344-2b66cb1b4894 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:22.204619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:22.306077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0d01-cb74-42d5-b344-2b66cb1b4894 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:22.353796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:22.354958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:22.355550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:22.356031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:22.356904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:22.357404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:22.359027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:22.372847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 69/145] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:22.378115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c205af-9e8f-45db-805e-78fbe86e56a5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:22.443566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:22.522078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c205af-9e8f-45db-805e-78fbe86e56a5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:22.581537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7a549-6aee-4699-b500-e06942389d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:22.582578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a549-6aee-4699-b500-e06942389d5d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:22.583060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a549-6aee-4699-b500-e06942389d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:22.583524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a549-6aee-4699-b500-e06942389d5d None admin] PATH_INFO: `/v3/users/12409bd4a3a9446fa3706e66d9892110` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:22.591175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7a549-6aee-4699-b500-e06942389d5d None admin] RBAC: Authorizing `identity:get_user(user_id=12409bd4a3a9446fa3706e66d9892110)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:22.592956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7a549-6aee-4699-b500-e06942389d5d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:22.594869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 77/146] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:22 2022] GET /identity/v3/users/12409bd4a3a9446fa3706e66d9892110 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:22.602277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:22.754414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:22.786986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed4a08-194d-442e-b860-e6917ab97c92 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:22.831885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e107ef-849a-4073-a3c3-7cc0e47c8803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:22.832893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e107ef-849a-4073-a3c3-7cc0e47c8803 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:22.833381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e107ef-849a-4073-a3c3-7cc0e47c8803 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:22.833840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e107ef-849a-4073-a3c3-7cc0e47c8803 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:22.839115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e107ef-849a-4073-a3c3-7cc0e47c8803 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:22.841072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e107ef-849a-4073-a3c3-7cc0e47c8803 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:22.843055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 70/147] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:22 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:22.849058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7a549-6aee-4699-b500-e06942389d5d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:22.906155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab1f7-f3d5-4a9e-aba4-d0d8127e211a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:22.906505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab1f7-f3d5-4a9e-aba4-d0d8127e211a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:22.906737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aab1f7-f3d5-4a9e-aba4-d0d8127e211a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:22.908523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 71/148] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:29:22.919891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd44b-2bf6-4c69-a620-46e85d812772 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:22.920185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd44b-2bf6-4c69-a620-46e85d812772 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:22.920429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fd44b-2bf6-4c69-a620-46e85d812772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:22.944587 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7e0fd44b-2bf6-4c69-a620-46e85d812772 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:22.945788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7e0fd44b-2bf6-4c69-a620-46e85d812772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:23.026166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7a549-6aee-4699-b500-e06942389d5d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:23.045336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 72/149] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 14:29:23.070749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:23.104326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bcc23-4b01-439d-90dc-c21c9a083d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:23.105102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bcc23-4b01-439d-90dc-c21c9a083d22 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:23.105451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bcc23-4b01-439d-90dc-c21c9a083d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:23.105726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bcc23-4b01-439d-90dc-c21c9a083d22 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06/users/12409bd4a3a9446fa3706e66d9892110/roles/cdc99bb66fcc41f1a2b5ce626fa22557` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:23.109507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bcc23-4b01-439d-90dc-c21c9a083d22 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eda274b900241bf883d02a37e874f06, user_id=12409bd4a3a9446fa3706e66d9892110, role_id=cdc99bb66fcc41f1a2b5ce626fa22557)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:23.111046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bcc23-4b01-439d-90dc-c21c9a083d22 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:23.131835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 78/150] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:22 2022] PUT /identity/v3/projects/1eda274b900241bf883d02a37e874f06/users/12409bd4a3a9446fa3706e66d9892110/roles/cdc99bb66fcc41f1a2b5ce626fa22557 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:23.333028 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbd53-62bf-42f2-8c4c-2df521abf214 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:23.333544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbd53-62bf-42f2-8c4c-2df521abf214 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:23.333645 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbd53-62bf-42f2-8c4c-2df521abf214 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:23.335223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 73/151] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:23.349248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2122395-7f0c-4b14-860d-baae3e8be8e1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:23.349859 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2122395-7f0c-4b14-860d-baae3e8be8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:23.350356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2122395-7f0c-4b14-860d-baae3e8be8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:23.375537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d2122395-7f0c-4b14-860d-baae3e8be8e1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:23.377079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d2122395-7f0c-4b14-860d-baae3e8be8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:23.471314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 79/152] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:23.524227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adbd53-62bf-42f2-8c4c-2df521abf214 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:23.610305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:23.647414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adbd53-62bf-42f2-8c4c-2df521abf214 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:23.685265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c31166-02f9-4547-b308-ca2082170b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:23.685916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c31166-02f9-4547-b308-ca2082170b8d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:23.686189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c31166-02f9-4547-b308-ca2082170b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:23.686479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c31166-02f9-4547-b308-ca2082170b8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:23.703110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c31166-02f9-4547-b308-ca2082170b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-36c31166-02f9-4547-b308-ca2082170b8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:23.708527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:23.709370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:23.710107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 74/153] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:23.715885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2122395-7f0c-4b14-860d-baae3e8be8e1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:23.887959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2122395-7f0c-4b14-860d-baae3e8be8e1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:23.890648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:23.933746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:23.934271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:23.934580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:23.934865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:23.935529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:23.935828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:23.937253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:23.943950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3e69-9b52-4bd0-8066-f05be3fecda0 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:23.944817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3e69-9b52-4bd0-8066-f05be3fecda0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:23.945092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3e69-9b52-4bd0-8066-f05be3fecda0 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:23.950780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 75/154] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:23.955496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 80/155] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:23.958328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a79d4-d65e-40b6-9382-c4f9253a586c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:23.958633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a79d4-d65e-40b6-9382-c4f9253a586c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:23.958884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a79d4-d65e-40b6-9382-c4f9253a586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:23.965561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:23.995682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f82a79d4-d65e-40b6-9382-c4f9253a586c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:23.997057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f82a79d4-d65e-40b6-9382-c4f9253a586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:24.123743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 76/156] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:24.124781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a79d4-d65e-40b6-9382-c4f9253a586c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:24.244969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ce48-15fa-4ab7-890a-c8d88c3cb05e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:24.262026 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:24.324483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a79d4-d65e-40b6-9382-c4f9253a586c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:24.370453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450943-988c-4784-9a1e-3d11a838839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:24.372055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450943-988c-4784-9a1e-3d11a838839c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:24.372638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450943-988c-4784-9a1e-3d11a838839c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:24.373053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450943-988c-4784-9a1e-3d11a838839c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:24.390462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d450943-988c-4784-9a1e-3d11a838839c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-0d450943-988c-4784-9a1e-3d11a838839c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:24.399953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:24.401276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:24.402344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:24.402991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b70d54-d8ea-4f90-985c-83e0f41a43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:24.403560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70d54-d8ea-4f90-985c-83e0f41a43a7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:24.403906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70d54-d8ea-4f90-985c-83e0f41a43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:24.404246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b70d54-d8ea-4f90-985c-83e0f41a43a7 None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:24.405114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 77/157] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:24.410433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b70d54-d8ea-4f90-985c-83e0f41a43a7 None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:24.416507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450943-988c-4784-9a1e-3d11a838839c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:24.420425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b70d54-d8ea-4f90-985c-83e0f41a43a7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:24.420425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 81/158] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:23 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:24.435491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b70d54-d8ea-4f90-985c-83e0f41a43a7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:24.594763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:24.642182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450943-988c-4784-9a1e-3d11a838839c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:24.692749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:24.714986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:24.715227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:24.715483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:24.716057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:24.718422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:24.718422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:24.718422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:24.737432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 78/159] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:24.744687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:24.886493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b70d54-d8ea-4f90-985c-83e0f41a43a7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:24.917101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93127e-c576-46d4-8f1d-5b114890bdb2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:24.971128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3146d0d-0915-416e-9a83-5ef3da3c6183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:24.971925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3146d0d-0915-416e-9a83-5ef3da3c6183 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:24.972201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3146d0d-0915-416e-9a83-5ef3da3c6183 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:24.972976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3146d0d-0915-416e-9a83-5ef3da3c6183 None admin] PATH_INFO: `/v3/users/43c4bb62b38b4ecb87897eea003a764f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:24.973592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3146d0d-0915-416e-9a83-5ef3da3c6183 None admin] RBAC: Authorizing `identity:get_user(user_id=43c4bb62b38b4ecb87897eea003a764f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:24.975218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3146d0d-0915-416e-9a83-5ef3da3c6183 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:24.976825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 79/160] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:24 2022] GET /identity/v3/users/43c4bb62b38b4ecb87897eea003a764f => generated 247 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:24.988083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3146d0d-0915-416e-9a83-5ef3da3c6183 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:25.030018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79fbe8-c772-46b6-868e-3195de5e9b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:25.030680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79fbe8-c772-46b6-868e-3195de5e9b55 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:25.031124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79fbe8-c772-46b6-868e-3195de5e9b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:25.031405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79fbe8-c772-46b6-868e-3195de5e9b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:25.068836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:25.134132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3146d0d-0915-416e-9a83-5ef3da3c6183 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:25.192308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70d94-c9ee-4b07-b67f-8b2953e019b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:25.193012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70d94-c9ee-4b07-b67f-8b2953e019b6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:25.193299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70d94-c9ee-4b07-b67f-8b2953e019b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:25.193568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70d94-c9ee-4b07-b67f-8b2953e019b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:25.235468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70d94-c9ee-4b07-b67f-8b2953e019b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-57f70d94-c9ee-4b07-b67f-8b2953e019b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:25.241128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:25.242075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:25.242894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 80/161] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:25.243511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70d94-c9ee-4b07-b67f-8b2953e019b6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:25.259329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79fbe8-c772-46b6-868e-3195de5e9b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:25.260860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79fbe8-c772-46b6-868e-3195de5e9b55 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:25.353186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:25.510489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70d94-c9ee-4b07-b67f-8b2953e019b6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:25.517796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 82/162] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1083 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:25.519301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d46b0-0c1f-45db-9a34-821325e4e0c2 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:25.519585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d46b0-0c1f-45db-9a34-821325e4e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:25.519856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d46b0-0c1f-45db-9a34-821325e4e0c2 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:25.521509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 83/163] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:25.522115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d46b0-0c1f-45db-9a34-821325e4e0c2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:25.532152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:25.579546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb236ba2-a34e-48a3-b549-ad6f4c5c9532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:25.580183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236ba2-a34e-48a3-b549-ad6f4c5c9532 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:25.580462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236ba2-a34e-48a3-b549-ad6f4c5c9532 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:25.580731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236ba2-a34e-48a3-b549-ad6f4c5c9532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:25.651899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb236ba2-a34e-48a3-b549-ad6f4c5c9532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:25.653464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb236ba2-a34e-48a3-b549-ad6f4c5c9532 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:25.728104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d46b0-0c1f-45db-9a34-821325e4e0c2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:25.764336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 81/164] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:25.765539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee480-e264-44a2-8408-41d47bd9bdcb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:25.765815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee480-e264-44a2-8408-41d47bd9bdcb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:25.766084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee480-e264-44a2-8408-41d47bd9bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:25.784334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:25.785062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:25.785340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:25.785662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:25.786335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:25.786717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:25.788139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:25.789734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:25.800025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 84/165] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:25.800959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:25.807407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5baee480-e264-44a2-8408-41d47bd9bdcb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:25.808693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5baee480-e264-44a2-8408-41d47bd9bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:25.817037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:25.943837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373b272-f417-43ff-8e24-09e3fab81fa0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:25.944648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 82/166] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:25.945508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee480-e264-44a2-8408-41d47bd9bdcb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:25.984726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2798ca2-f9e9-4df9-a25d-4eaccb6c8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:25.985970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798ca2-f9e9-4df9-a25d-4eaccb6c8397 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:25.986920 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798ca2-f9e9-4df9-a25d-4eaccb6c8397 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:25.987365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798ca2-f9e9-4df9-a25d-4eaccb6c8397 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:25.988782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2798ca2-f9e9-4df9-a25d-4eaccb6c8397 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:25.991120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2798ca2-f9e9-4df9-a25d-4eaccb6c8397 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:25.993093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 85/167] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:25 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:25.994132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2798ca2-f9e9-4df9-a25d-4eaccb6c8397 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:26.091730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:26.153023 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2798ca2-f9e9-4df9-a25d-4eaccb6c8397 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:26.154463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee480-e264-44a2-8408-41d47bd9bdcb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:26.223385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386c0d-df8c-4144-a323-e931d22a090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:26.224003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386c0d-df8c-4144-a323-e931d22a090e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:26.224287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386c0d-df8c-4144-a323-e931d22a090e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:26.224564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9386c0d-df8c-4144-a323-e931d22a090e None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:26.229463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ced26-583c-4a3d-bef8-2a45c22e1575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:26.231185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ced26-583c-4a3d-bef8-2a45c22e1575 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:26.231400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9386c0d-df8c-4144-a323-e931d22a090e None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:26.231918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ced26-583c-4a3d-bef8-2a45c22e1575 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:26.232414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ced26-583c-4a3d-bef8-2a45c22e1575 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:26.232912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9386c0d-df8c-4144-a323-e931d22a090e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:26.234101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ced26-583c-4a3d-bef8-2a45c22e1575 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:26.234659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 86/168] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:25 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:26.235449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386c0d-df8c-4144-a323-e931d22a090e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:26.236446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ced26-583c-4a3d-bef8-2a45c22e1575 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:26.238528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 83/169] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:25 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:26.244571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ced26-583c-4a3d-bef8-2a45c22e1575 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:26.273409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:26.421323 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ced26-583c-4a3d-bef8-2a45c22e1575 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:26.438763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9386c0d-df8c-4144-a323-e931d22a090e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:26.461501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:26.462620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:26.463091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:26.463566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:26.464519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=1eda274b900241bf883d02a37e874f06, user.id=43c4bb62b38b4ecb87897eea003a764f) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:26.465017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:26.466701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:26.473507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 84/170] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:26 2022] GET /identity/v3/role_assignments?user.id=43c4bb62b38b4ecb87897eea003a764f&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:26.474688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:26.519609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:26.536952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502944b8-a740-4bd2-b93f-d510e155da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:26.537252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502944b8-a740-4bd2-b93f-d510e155da46 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:26.537550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502944b8-a740-4bd2-b93f-d510e155da46 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:26.537862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502944b8-a740-4bd2-b93f-d510e155da46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:26.538641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502944b8-a740-4bd2-b93f-d510e155da46 None admin] RBAC: Adding query filter params (role.id=2284ec91b47444249d339c70801cd407, scope.project.id=1eda274b900241bf883d02a37e874f06, user.id=8c7c471adf5d45d9bc0f2ee644a28cad) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:26.538956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502944b8-a740-4bd2-b93f-d510e155da46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:26.540451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502944b8-a740-4bd2-b93f-d510e155da46 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:26.556742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 87/171] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:26 2022] GET /identity/v3/role_assignments?user.id=8c7c471adf5d45d9bc0f2ee644a28cad&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=2284ec91b47444249d339c70801cd407 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:26.558912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f2e1b-1fd0-4a1c-9edf-0a0fe71a6253 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:26.559221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f2e1b-1fd0-4a1c-9edf-0a0fe71a6253 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:26.559498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f2e1b-1fd0-4a1c-9edf-0a0fe71a6253 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:26.561022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 88/172] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:26.561630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f2e1b-1fd0-4a1c-9edf-0a0fe71a6253 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:26.575488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:26.625367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929fb0-bfb8-4532-b997-716e5ac7649a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:26.693524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb6872-476e-4ea9-a556-acd3f7e1c160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:26.694976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6872-476e-4ea9-a556-acd3f7e1c160 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:26.695919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6872-476e-4ea9-a556-acd3f7e1c160 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:26.696814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6872-476e-4ea9-a556-acd3f7e1c160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:26.821145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb6872-476e-4ea9-a556-acd3f7e1c160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:26.823260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb6872-476e-4ea9-a556-acd3f7e1c160 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:26.881505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f2e1b-1fd0-4a1c-9edf-0a0fe71a6253 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:26.962157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253341a-3dca-4686-b036-32457022817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:26.962844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253341a-3dca-4686-b036-32457022817d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:26.963118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253341a-3dca-4686-b036-32457022817d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:26.963388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253341a-3dca-4686-b036-32457022817d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:26.981884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253341a-3dca-4686-b036-32457022817d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-f253341a-3dca-4686-b036-32457022817d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:26.990033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:26.990969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:26.991736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:26.992322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 89/173] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:29:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:26.996569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573ea6-1cbd-41c2-bd9b-890eb8e602bf None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:26.996569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573ea6-1cbd-41c2-bd9b-890eb8e602bf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:26.996569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573ea6-1cbd-41c2-bd9b-890eb8e602bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.003049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:27.034211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7f573ea6-1cbd-41c2-bd9b-890eb8e602bf None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:27.035449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7f573ea6-1cbd-41c2-bd9b-890eb8e602bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:27.051838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 85/174] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:27.052950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb6872-476e-4ea9-a556-acd3f7e1c160 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:27.121750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:27.146972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 90/175] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:27.147911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f573ea6-1cbd-41c2-bd9b-890eb8e602bf None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:27.269146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f573ea6-1cbd-41c2-bd9b-890eb8e602bf None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:27.273074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb6872-476e-4ea9-a556-acd3f7e1c160 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:27.316900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:27.317535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.317840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.318106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.318462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cf34c-e88a-492a-ba49-91a56338006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:27.318812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:27.319112 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:27.319713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cf34c-e88a-492a-ba49-91a56338006b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.320179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cf34c-e88a-492a-ba49-91a56338006b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.320519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:27.320865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cf34c-e88a-492a-ba49-91a56338006b None admin] PATH_INFO: `/v3/projects/b8421dd156f746a39f2bb4aced9eb560` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.322268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cf34c-e88a-492a-ba49-91a56338006b None admin] RBAC: Authorizing `identity:get_project(project_id=b8421dd156f746a39f2bb4aced9eb560)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:27.326186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cf34c-e88a-492a-ba49-91a56338006b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:27.329113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 91/176] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:27 2022] GET /identity/v3/projects/b8421dd156f746a39f2bb4aced9eb560 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:27.330350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb515-a4fa-4aa1-9f04-71b413435207 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.330645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb515-a4fa-4aa1-9f04-71b413435207 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.330909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb515-a4fa-4aa1-9f04-71b413435207 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.332143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 92/177] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:27.333151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da7563-f0ea-4c08-b363-d070b889a246 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.333423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da7563-f0ea-4c08-b363-d070b889a246 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.333689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da7563-f0ea-4c08-b363-d070b889a246 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.338363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 93/178] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:27.338363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0714b-73a9-46dc-bc3b-ec003135cc41 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.338363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0714b-73a9-46dc-bc3b-ec003135cc41 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.338363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0714b-73a9-46dc-bc3b-ec003135cc41 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.338735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 86/179] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:29:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:27.338811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 94/180] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:27.339275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:27.343850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a25a8-e5ab-408b-bc8c-3c78b64c47f4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.343850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a25a8-e5ab-408b-bc8c-3c78b64c47f4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.343850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a25a8-e5ab-408b-bc8c-3c78b64c47f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.361511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a76a25a8-e5ab-408b-bc8c-3c78b64c47f4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:27.362774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a76a25a8-e5ab-408b-bc8c-3c78b64c47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:27.418203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:27.431435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:27.453239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 95/181] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:27.465435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a25a8-e5ab-408b-bc8c-3c78b64c47f4 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:27.524798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90bb8-1b20-4076-9459-9b70644e228d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:27.575655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276c440-171f-4546-aa53-bb99a01ccbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:27.576776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276c440-171f-4546-aa53-bb99a01ccbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.577244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276c440-171f-4546-aa53-bb99a01ccbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.577624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276c440-171f-4546-aa53-bb99a01ccbe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.578902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276c440-171f-4546-aa53-bb99a01ccbe3 None admin] RBAC: Adding query filter params (role.id=2284ec91b47444249d339c70801cd407, scope.project.id=b8421dd156f746a39f2bb4aced9eb560, user.id=8c7c471adf5d45d9bc0f2ee644a28cad) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:27.579696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276c440-171f-4546-aa53-bb99a01ccbe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:27.581295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276c440-171f-4546-aa53-bb99a01ccbe3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:27.598413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 87/182] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:27 2022] GET /identity/v3/role_assignments?user.id=8c7c471adf5d45d9bc0f2ee644a28cad&scope.project.id=b8421dd156f746a39f2bb4aced9eb560&role.id=2284ec91b47444249d339c70801cd407 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:27.598413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d80de5-85e2-4701-bd3a-be35b59369a2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.598413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d80de5-85e2-4701-bd3a-be35b59369a2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.598413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d80de5-85e2-4701-bd3a-be35b59369a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.619717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a25a8-e5ab-408b-bc8c-3c78b64c47f4 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:27.626156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c4d80de5-85e2-4701-bd3a-be35b59369a2 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:27.628367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c4d80de5-85e2-4701-bd3a-be35b59369a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:27.679831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82ff85-3376-4a04-9786-c59fc50b2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:27.680645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82ff85-3376-4a04-9786-c59fc50b2a8d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.681056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82ff85-3376-4a04-9786-c59fc50b2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.681402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82ff85-3376-4a04-9786-c59fc50b2a8d None admin] PATH_INFO: `/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.683418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82ff85-3376-4a04-9786-c59fc50b2a8d None admin] RBAC: Authorizing `identity:get_user(user_id=8c7c471adf5d45d9bc0f2ee644a28cad)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:27.685616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82ff85-3376-4a04-9786-c59fc50b2a8d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:27.687585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 96/183] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:27 2022] GET /identity/v3/users/8c7c471adf5d45d9bc0f2ee644a28cad => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:27.689437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2ec27-bc07-4722-bd54-70759e13db44 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.689798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2ec27-bc07-4722-bd54-70759e13db44 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.690143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2ec27-bc07-4722-bd54-70759e13db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.715170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7fb2ec27-bc07-4722-bd54-70759e13db44 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:27.717045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7fb2ec27-bc07-4722-bd54-70759e13db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:27.755525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 88/184] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:27.756803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d80de5-85e2-4701-bd3a-be35b59369a2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:27.787299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:27.812197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:27.819302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 97/185] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:27.820323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2ec27-bc07-4722-bd54-70759e13db44 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:27.912952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d80de5-85e2-4701-bd3a-be35b59369a2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:27.955038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2ec27-bc07-4722-bd54-70759e13db44 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:27.965943 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a13a-827d-421d-81fc-e5c6525d42f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:27.966687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a13a-827d-421d-81fc-e5c6525d42f5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:27.966972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a13a-827d-421d-81fc-e5c6525d42f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:27.967243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a13a-827d-421d-81fc-e5c6525d42f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:27.984904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a13a-827d-421d-81fc-e5c6525d42f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ef17a13a-827d-421d-81fc-e5c6525d42f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:27.999536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:28.000486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:28.001266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:28.004496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 89/186] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:28.010675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a13a-827d-421d-81fc-e5c6525d42f5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.025966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67131-9bb0-4950-9a80-61372115c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:28.027100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67131-9bb0-4950-9a80-61372115c325 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:28.027100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67131-9bb0-4950-9a80-61372115c325 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:28.027510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67131-9bb0-4950-9a80-61372115c325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:28.112322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:28.138168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c67131-9bb0-4950-9a80-61372115c325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:28.139700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c67131-9bb0-4950-9a80-61372115c325 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:28.154155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:28.170674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a13a-827d-421d-81fc-e5c6525d42f5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:28.220874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36d37-a380-4216-88fd-908fd05d848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:28.221868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36d37-a380-4216-88fd-908fd05d848a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:28.222162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36d37-a380-4216-88fd-908fd05d848a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:28.222604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36d37-a380-4216-88fd-908fd05d848a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:28.237809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36d37-a380-4216-88fd-908fd05d848a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-76b36d37-a380-4216-88fd-908fd05d848a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:28.242839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:28.244743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 90/187] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:29:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:28.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36d37-a380-4216-88fd-908fd05d848a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.276656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 98/188] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:28.277651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67131-9bb0-4950-9a80-61372115c325 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.374516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:28.393243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36d37-a380-4216-88fd-908fd05d848a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:28.398484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67131-9bb0-4950-9a80-61372115c325 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:28.429341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:28.429965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:28.430234 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:28.430531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:28.431202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:28.431496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:28.432973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:28.442320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 91/189] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:28.443345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.451690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ff1a-3e7a-45cd-9bf5-e5a2a9eff8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:28.452427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ff1a-3e7a-45cd-9bf5-e5a2a9eff8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:28.452761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ff1a-3e7a-45cd-9bf5-e5a2a9eff8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:28.453084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ff1a-3e7a-45cd-9bf5-e5a2a9eff8d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:28.463410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:28.467709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3ff1a-3e7a-45cd-9bf5-e5a2a9eff8d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-1ef3ff1a-3e7a-45cd-9bf5-e5a2a9eff8d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:28.473684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:28.475511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 99/190] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:28.477271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ff1a-3e7a-45cd-9bf5-e5a2a9eff8d5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.584716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab86f1b-70f5-45fc-8a33-be4b754ab394 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:28.600323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ff1a-3e7a-45cd-9bf5-e5a2a9eff8d5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:28.631746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a72a0-796f-476a-b249-1a0f69a5dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:28.632590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a72a0-796f-476a-b249-1a0f69a5dda4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:28.633038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a72a0-796f-476a-b249-1a0f69a5dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:28.633434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a72a0-796f-476a-b249-1a0f69a5dda4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:28.635209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a72a0-796f-476a-b249-1a0f69a5dda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:28.637198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a72a0-796f-476a-b249-1a0f69a5dda4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:28.639782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 92/191] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:28.640962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a72a0-796f-476a-b249-1a0f69a5dda4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.647986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:28.648834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:28.649270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:28.649697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:28.650819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:28.651309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:28.653748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:28.664413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 100/192] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:29:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:28.665787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.671800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:28.759072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:28.782284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a72a0-796f-476a-b249-1a0f69a5dda4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:28.796658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94510491-3b7f-4fb1-b67d-be2d3d2a8e81 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:28.819454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e9ccd-d5ad-4805-975d-f4f17960f368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:28.820104 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e9ccd-d5ad-4805-975d-f4f17960f368 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:28.820378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e9ccd-d5ad-4805-975d-f4f17960f368 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:28.820648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e9ccd-d5ad-4805-975d-f4f17960f368 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:28.821800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e9ccd-d5ad-4805-975d-f4f17960f368 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:28.823294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e9ccd-d5ad-4805-975d-f4f17960f368 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:28.825500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 93/193] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:28 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:28.826285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e9ccd-d5ad-4805-975d-f4f17960f368 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.853151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa516-d90a-4afd-b34b-833e0298428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:28.853800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa516-d90a-4afd-b34b-833e0298428d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:28.854071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa516-d90a-4afd-b34b-833e0298428d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:28.854341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa516-d90a-4afd-b34b-833e0298428d None admin] PATH_INFO: `/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:28.869830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afa516-d90a-4afd-b34b-833e0298428d None admin] RBAC: Authorizing `identity:get_user(user_id=ac0c4e10c4784958ac631e3fc6f2eaa8)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:28.872565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afa516-d90a-4afd-b34b-833e0298428d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:28.879620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 101/194] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:28 2022] GET /identity/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:28.879620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa516-d90a-4afd-b34b-833e0298428d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:28.939300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:28.974134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e9ccd-d5ad-4805-975d-f4f17960f368 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:28.991804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa516-d90a-4afd-b34b-833e0298428d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:29.023044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:29.023955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:29.024392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:29.024770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:29.025805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:29.026254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:29.028739 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:29.038495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e81535-bd1b-4840-9b88-fc396fc5f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:29.038834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 94/195] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:29.039609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e81535-bd1b-4840-9b88-fc396fc5f23b None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:29.039980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e81535-bd1b-4840-9b88-fc396fc5f23b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:29.040229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:29.040542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e81535-bd1b-4840-9b88-fc396fc5f23b None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:29.041271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e81535-bd1b-4840-9b88-fc396fc5f23b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:29.043379 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e81535-bd1b-4840-9b88-fc396fc5f23b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:29.058295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:29.069816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 102/196] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:29:28 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:29.079579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e81535-bd1b-4840-9b88-fc396fc5f23b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:29.202514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84d46-8292-44d0-9fe4-d180ca83f10c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:29.246233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e81535-bd1b-4840-9b88-fc396fc5f23b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:29.248305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fca38-d67a-481a-a37e-5b2a7f456dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:29.249562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fca38-d67a-481a-a37e-5b2a7f456dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:29.250049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fca38-d67a-481a-a37e-5b2a7f456dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:29.251552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fca38-d67a-481a-a37e-5b2a7f456dd1 None admin] PATH_INFO: `/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:29.253051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fca38-d67a-481a-a37e-5b2a7f456dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0c4e10c4784958ac631e3fc6f2eaa8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:29.254875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fca38-d67a-481a-a37e-5b2a7f456dd1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:29.256788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 95/197] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:29 2022] GET /identity/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:29.258281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fca38-d67a-481a-a37e-5b2a7f456dd1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:29.286706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:29.314848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:29.316105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:29.316483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:29.316934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:29.317865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] RBAC: Adding query filter params (role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=1eda274b900241bf883d02a37e874f06, user.id=8c7c471adf5d45d9bc0f2ee644a28cad) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:29.318318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:29.320898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:29.333072 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 103/198] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:29 2022] GET /identity/v3/role_assignments?user.id=8c7c471adf5d45d9bc0f2ee644a28cad&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:29.335307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:29.373466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:29.427639 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fca38-d67a-481a-a37e-5b2a7f456dd1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:29.490741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8c7cd-d2b5-4bc9-b69d-ff47d5222301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:29.491789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c7cd-d2b5-4bc9-b69d-ff47d5222301 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:29.492061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c7cd-d2b5-4bc9-b69d-ff47d5222301 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:29.492330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c7cd-d2b5-4bc9-b69d-ff47d5222301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:29.533711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a73fe-e1d2-49f8-86f1-bec259b0d0df None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:29.581917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ea6b-b3d9-4597-83e7-ba626278e18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:29.582617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ea6b-b3d9-4597-83e7-ba626278e18d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:29.582927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ea6b-b3d9-4597-83e7-ba626278e18d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:29.583154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ea6b-b3d9-4597-83e7-ba626278e18d None admin] PATH_INFO: `/v3/users/12409bd4a3a9446fa3706e66d9892110` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:29.584452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ea6b-b3d9-4597-83e7-ba626278e18d None admin] RBAC: Authorizing `identity:get_user(user_id=12409bd4a3a9446fa3706e66d9892110)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:29.586061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ea6b-b3d9-4597-83e7-ba626278e18d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:29.588225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 104/199] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:29 2022] GET /identity/v3/users/12409bd4a3a9446fa3706e66d9892110 => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:29.589193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ea6b-b3d9-4597-83e7-ba626278e18d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:29.620598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8c7cd-d2b5-4bc9-b69d-ff47d5222301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:29.624559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8c7cd-d2b5-4bc9-b69d-ff47d5222301 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:29.646270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:29.705166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ea6b-b3d9-4597-83e7-ba626278e18d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:29.745138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d206813-8e48-4902-8b6c-f9e014b93b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:29.746327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d206813-8e48-4902-8b6c-f9e014b93b13 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:29.746784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d206813-8e48-4902-8b6c-f9e014b93b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:29.747160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d206813-8e48-4902-8b6c-f9e014b93b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:29.794343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:29.852602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 96/200] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:29.852841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d206813-8e48-4902-8b6c-f9e014b93b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:29.854101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8c7cd-d2b5-4bc9-b69d-ff47d5222301 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:29.854254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d206813-8e48-4902-8b6c-f9e014b93b13 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:29.959618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:30.011079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8c7cd-d2b5-4bc9-b69d-ff47d5222301 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:30.052302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 105/201] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:30.053782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d206813-8e48-4902-8b6c-f9e014b93b13 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:30.075579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d00b-ebc2-42d3-8ff9-e1be3954a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:30.076869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d00b-ebc2-42d3-8ff9-e1be3954a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:30.077306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d00b-ebc2-42d3-8ff9-e1be3954a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:30.077744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d00b-ebc2-42d3-8ff9-e1be3954a5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:30.164496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:30.211789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d00b-ebc2-42d3-8ff9-e1be3954a5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:30.222409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d00b-ebc2-42d3-8ff9-e1be3954a5b1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:30.257692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d206813-8e48-4902-8b6c-f9e014b93b13 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:30.325915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037b202-5ec9-4c53-8387-b8fdc17b47ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:30.327017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b202-5ec9-4c53-8387-b8fdc17b47ba None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:30.327494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b202-5ec9-4c53-8387-b8fdc17b47ba None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:30.327964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b202-5ec9-4c53-8387-b8fdc17b47ba None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:30.331388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037b202-5ec9-4c53-8387-b8fdc17b47ba None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:30.335039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037b202-5ec9-4c53-8387-b8fdc17b47ba None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:30.340815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 106/202] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:30 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:30.342791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037b202-5ec9-4c53-8387-b8fdc17b47ba None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:30.384233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:30.435239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 97/203] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:30.436877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d00b-ebc2-42d3-8ff9-e1be3954a5b1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:30.570415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037b202-5ec9-4c53-8387-b8fdc17b47ba None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:30.602182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:30.644141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d00b-ebc2-42d3-8ff9-e1be3954a5b1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:30.650656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76fecb-3679-4e1b-8d36-9a45f78630f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:30.652353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76fecb-3679-4e1b-8d36-9a45f78630f2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:30.653075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76fecb-3679-4e1b-8d36-9a45f78630f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:30.653786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76fecb-3679-4e1b-8d36-9a45f78630f2 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:30.656071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76fecb-3679-4e1b-8d36-9a45f78630f2 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:30.659951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76fecb-3679-4e1b-8d36-9a45f78630f2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:30.664096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 107/204] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:30 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:30.665734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76fecb-3679-4e1b-8d36-9a45f78630f2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:30.721566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:30.723248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:30.724313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:30.725048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:30.727578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=b76ad539b19f499fa6232d0ca420603c, user.id=ac0c4e10c4784958ac631e3fc6f2eaa8) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:30.728353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:30.732610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:30.747235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 98/205] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:30 2022] GET /identity/v3/role_assignments?user.id=ac0c4e10c4784958ac631e3fc6f2eaa8&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:30.749082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:30.895890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:30.917444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76fecb-3679-4e1b-8d36-9a45f78630f2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:30.965602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8010-16bf-491e-954e-e24b2409de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:30.966628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8010-16bf-491e-954e-e24b2409de95 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:30.967113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8010-16bf-491e-954e-e24b2409de95 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:30.967575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8010-16bf-491e-954e-e24b2409de95 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:30.969164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8010-16bf-491e-954e-e24b2409de95 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:30.971183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8010-16bf-491e-954e-e24b2409de95 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:30.973619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 108/206] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:30 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:30.981911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8010-16bf-491e-954e-e24b2409de95 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:31.127604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac805c-be2f-44be-af39-db7c8fcc4177 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:31.251669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534f9f5-2f93-4743-953e-291c93f04efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:31.252713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f9f5-2f93-4743-953e-291c93f04efc None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:31.253127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f9f5-2f93-4743-953e-291c93f04efc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:31.253707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534f9f5-2f93-4743-953e-291c93f04efc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:31.254956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f9f5-2f93-4743-953e-291c93f04efc None admin] RBAC: Adding query filter params (role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=b76ad539b19f499fa6232d0ca420603c, user.id=ac0c4e10c4784958ac631e3fc6f2eaa8) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:31.255438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f9f5-2f93-4743-953e-291c93f04efc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:31.258064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534f9f5-2f93-4743-953e-291c93f04efc None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:31.265272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8010-16bf-491e-954e-e24b2409de95 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:31.280656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 99/207] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:30 2022] GET /identity/v3/role_assignments?user.id=ac0c4e10c4784958ac631e3fc6f2eaa8&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 259 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:31.352020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caa919-e23b-47fc-96fc-b5369861de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:31.353503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caa919-e23b-47fc-96fc-b5369861de9e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:31.354199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caa919-e23b-47fc-96fc-b5369861de9e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:31.354929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caa919-e23b-47fc-96fc-b5369861de9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:31.356546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caa919-e23b-47fc-96fc-b5369861de9e None admin] RBAC: Adding query filter params (role.id=cdc99bb66fcc41f1a2b5ce626fa22557, scope.project.id=1eda274b900241bf883d02a37e874f06, user.id=12409bd4a3a9446fa3706e66d9892110) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:31.357412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caa919-e23b-47fc-96fc-b5369861de9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:31.360286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caa919-e23b-47fc-96fc-b5369861de9e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:31.372377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 109/208] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:30 2022] GET /identity/v3/role_assignments?user.id=12409bd4a3a9446fa3706e66d9892110&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=cdc99bb66fcc41f1a2b5ce626fa22557 => generated 608 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:32.554442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756a5b-d38a-4d49-940c-ed9987cab8e5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:32.555971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756a5b-d38a-4d49-940c-ed9987cab8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:32.556704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756a5b-d38a-4d49-940c-ed9987cab8e5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:32.559953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 100/209] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:32.568869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d8b67-6016-4855-b187-5737f31974ba None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:32.570244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d8b67-6016-4855-b187-5737f31974ba None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:32.571014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d8b67-6016-4855-b187-5737f31974ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:32.604930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-947d8b67-6016-4855-b187-5737f31974ba None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:32.607577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-947d8b67-6016-4855-b187-5737f31974ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:32.640054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:32.719897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 110/210] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:32.784155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7348c-20e3-4293-8d13-2946d97c47a5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:32.784627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7348c-20e3-4293-8d13-2946d97c47a5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:32.785113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7348c-20e3-4293-8d13-2946d97c47a5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:32.787271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 101/211] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:32.794970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b083a2-2d91-4f08-9cb3-689165da3b51 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:32.795606 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b083a2-2d91-4f08-9cb3-689165da3b51 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:32.796075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b083a2-2d91-4f08-9cb3-689165da3b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:32.817170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-26b083a2-2d91-4f08-9cb3-689165da3b51 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:32.818864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-26b083a2-2d91-4f08-9cb3-689165da3b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:32.902654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 111/212] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:33.188070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7348c-20e3-4293-8d13-2946d97c47a5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:33.196259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d595-04b1-42aa-b775-a778b7a024d4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.196589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d595-04b1-42aa-b775-a778b7a024d4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.196804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d595-04b1-42aa-b775-a778b7a024d4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.198259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 112/213] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:29:33.199622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:33.204867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca8dc-125c-42c7-82c0-501d94a1a482 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.205209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca8dc-125c-42c7-82c0-501d94a1a482 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.205413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca8dc-125c-42c7-82c0-501d94a1a482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.233616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b6bca8dc-125c-42c7-82c0-501d94a1a482 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:33.235661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b6bca8dc-125c-42c7-82c0-501d94a1a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:33.307629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7348c-20e3-4293-8d13-2946d97c47a5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:33.347043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f288a-0054-4f55-9ca8-baf22868a1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:33.347706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f288a-0054-4f55-9ca8-baf22868a1bb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.347977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f288a-0054-4f55-9ca8-baf22868a1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.348240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f288a-0054-4f55-9ca8-baf22868a1bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.360920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f288a-0054-4f55-9ca8-baf22868a1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f73f288a-0054-4f55-9ca8-baf22868a1bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:33.365737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:33.367471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:33.369163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 102/214] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:33.372213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 113/215] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:33.372708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f288a-0054-4f55-9ca8-baf22868a1bb None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:33.374101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca8dc-125c-42c7-82c0-501d94a1a482 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:33.394933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:33.455452 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:33.499307 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f288a-0054-4f55-9ca8-baf22868a1bb None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:33.516399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca8dc-125c-42c7-82c0-501d94a1a482 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:33.545079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe8c64-7d34-4c6a-b5dc-06f7bca29801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:33.546324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8c64-7d34-4c6a-b5dc-06f7bca29801 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.546857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8c64-7d34-4c6a-b5dc-06f7bca29801 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.547300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8c64-7d34-4c6a-b5dc-06f7bca29801 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.548947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe8c64-7d34-4c6a-b5dc-06f7bca29801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:33.550772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe8c64-7d34-4c6a-b5dc-06f7bca29801 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:33.553229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 103/216] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:33.559046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe8c64-7d34-4c6a-b5dc-06f7bca29801 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:33.559736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:33.560631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.561323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.561817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.562967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:33.563608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:33.566263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:33.581562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 114/217] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:33.589742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:33.683649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:33.695675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe8c64-7d34-4c6a-b5dc-06f7bca29801 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:33.716872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a280c0-7c37-44e9-bfb2-6b3aa9d4f8fa None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:33.747849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b7581-bbbc-420a-9fee-722d5bdd2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:33.748492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7581-bbbc-420a-9fee-722d5bdd2067 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.748770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7581-bbbc-420a-9fee-722d5bdd2067 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.749042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7581-bbbc-420a-9fee-722d5bdd2067 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.749706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7581-bbbc-420a-9fee-722d5bdd2067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:33.751222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7581-bbbc-420a-9fee-722d5bdd2067 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:33.751918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f7193-9a5b-432a-975a-c6bb3766648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:33.752552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f7193-9a5b-432a-975a-c6bb3766648d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.752829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f7193-9a5b-432a-975a-c6bb3766648d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.753099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f7193-9a5b-432a-975a-c6bb3766648d None admin] PATH_INFO: `/v3/users/f8bfe6b4e2f24f219f944efe3df017d4` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.759427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:33.768590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f7193-9a5b-432a-975a-c6bb3766648d None admin] RBAC: Authorizing `identity:get_user(user_id=f8bfe6b4e2f24f219f944efe3df017d4)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:33.770234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f7193-9a5b-432a-975a-c6bb3766648d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:33.771965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 115/218] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:33 2022] GET /identity/v3/users/f8bfe6b4e2f24f219f944efe3df017d4 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:33.773149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e536066-dec8-4474-9399-47b433261779 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.773427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e536066-dec8-4474-9399-47b433261779 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.773693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e536066-dec8-4474-9399-47b433261779 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.775036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 116/219] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:33.775591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e536066-dec8-4474-9399-47b433261779 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:33.779040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 104/220] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:29:33 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:33.780794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890832c-4e6e-499c-9024-bf4f3bba19a8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.781212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890832c-4e6e-499c-9024-bf4f3bba19a8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.781389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890832c-4e6e-499c-9024-bf4f3bba19a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.801318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a890832c-4e6e-499c-9024-bf4f3bba19a8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:33.802711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a890832c-4e6e-499c-9024-bf4f3bba19a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:33.889860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 105/221] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:33.891177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890832c-4e6e-499c-9024-bf4f3bba19a8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:33.927431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e536066-dec8-4474-9399-47b433261779 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:33.966170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:33.976596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f526310-5fe8-4780-a639-769b966aae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:33.977645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f526310-5fe8-4780-a639-769b966aae18 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:33.978022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f526310-5fe8-4780-a639-769b966aae18 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:33.978303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f526310-5fe8-4780-a639-769b966aae18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:33.992091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f526310-5fe8-4780-a639-769b966aae18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-2f526310-5fe8-4780-a639-769b966aae18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:33.998633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:33.999551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:34.000337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 117/222] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:34.008177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f526310-5fe8-4780-a639-769b966aae18 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:34.053279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890832c-4e6e-499c-9024-bf4f3bba19a8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:34.084792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:34.107616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e399baf-53d1-4204-9237-c85e86c2b971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:34.108259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e399baf-53d1-4204-9237-c85e86c2b971 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:34.108536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e399baf-53d1-4204-9237-c85e86c2b971 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:34.108804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e399baf-53d1-4204-9237-c85e86c2b971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:34.173771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f526310-5fe8-4780-a639-769b966aae18 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:34.214904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e399baf-53d1-4204-9237-c85e86c2b971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:34.216396 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e399baf-53d1-4204-9237-c85e86c2b971 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:34.217779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:34.218447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:34.218723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:34.218989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:34.220302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:34.220302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:34.221393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:34.236410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 118/223] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:34.237232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:34.326764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:34.421432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eabea7-759c-4157-9c1d-f59fb763d5ed None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:34.424912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 106/224] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:34.428336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e399baf-53d1-4204-9237-c85e86c2b971 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:34.460680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:34.490486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a832a-4107-4833-9f5a-e29945777c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:34.492531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a832a-4107-4833-9f5a-e29945777c5c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:34.493662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a832a-4107-4833-9f5a-e29945777c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:34.494338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a832a-4107-4833-9f5a-e29945777c5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:34.513708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a832a-4107-4833-9f5a-e29945777c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-bf5a832a-4107-4833-9f5a-e29945777c5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:34.522863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:34.523798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:34.524566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:34.533424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 119/225] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:29:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:34.534878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a832a-4107-4833-9f5a-e29945777c5c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:34.563869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e399baf-53d1-4204-9237-c85e86c2b971 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:34.624835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17f7c-52e1-4bc9-b7a6-3a8b76672aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:34.625938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17f7c-52e1-4bc9-b7a6-3a8b76672aaf None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:34.626519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17f7c-52e1-4bc9-b7a6-3a8b76672aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:34.626966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17f7c-52e1-4bc9-b7a6-3a8b76672aaf None admin] PATH_INFO: `/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:34.629145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e17f7c-52e1-4bc9-b7a6-3a8b76672aaf None admin] RBAC: Authorizing `identity:get_user(user_id=ac0c4e10c4784958ac631e3fc6f2eaa8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:34.631957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e17f7c-52e1-4bc9-b7a6-3a8b76672aaf None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:34.635642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 107/226] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:34 2022] GET /identity/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:34.637291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17f7c-52e1-4bc9-b7a6-3a8b76672aaf None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:34.648050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a832a-4107-4833-9f5a-e29945777c5c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:34.684914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ed41-79ee-4967-8262-426cfc42c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:34.685931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ed41-79ee-4967-8262-426cfc42c0fa None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:34.686415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ed41-79ee-4967-8262-426cfc42c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:34.686974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ed41-79ee-4967-8262-426cfc42c0fa None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:34.688464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59ed41-79ee-4967-8262-426cfc42c0fa None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:34.690209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59ed41-79ee-4967-8262-426cfc42c0fa None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:34.692378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 120/227] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:34 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:34.693406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ed41-79ee-4967-8262-426cfc42c0fa None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:34.706627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:34.801240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ed41-79ee-4967-8262-426cfc42c0fa None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:34.807261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:34.830368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17f7c-52e1-4bc9-b7a6-3a8b76672aaf None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:34.839608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3c539-23ab-4fb7-b884-f4c2c6b2ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:34.840571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3c539-23ab-4fb7-b884-f4c2c6b2ac7b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:34.841037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3c539-23ab-4fb7-b884-f4c2c6b2ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:34.841507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3c539-23ab-4fb7-b884-f4c2c6b2ac7b None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:34.842841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3c539-23ab-4fb7-b884-f4c2c6b2ac7b None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:34.844624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3c539-23ab-4fb7-b884-f4c2c6b2ac7b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:34.846557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 121/228] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:34 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:34.847749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3c539-23ab-4fb7-b884-f4c2c6b2ac7b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:34.891313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:34.892365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:34.892850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:34.893332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:34.894576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:34.895125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:34.897733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:34.919828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 108/229] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:29:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:34.920434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:34.927151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:34.962521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3c539-23ab-4fb7-b884-f4c2c6b2ac7b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:35.000269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:35.001365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:35.001837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:35.002294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:35.003357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] RBAC: Adding query filter params (role.id=2284ec91b47444249d339c70801cd407, scope.project.id=b76ad539b19f499fa6232d0ca420603c, user.id=f8bfe6b4e2f24f219f944efe3df017d4) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:35.003949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:35.005647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:35.012568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 122/230] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:34 2022] GET /identity/v3/role_assignments?user.id=f8bfe6b4e2f24f219f944efe3df017d4&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=2284ec91b47444249d339c70801cd407 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:35.013936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:35.065499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d3a31-4202-474f-a55c-5b24066201f8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:35.122799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12b381-bec3-4b51-9fe5-f87e6467c19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:35.123639 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12b381-bec3-4b51-9fe5-f87e6467c19a None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:35.123919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12b381-bec3-4b51-9fe5-f87e6467c19a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:35.124197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12b381-bec3-4b51-9fe5-f87e6467c19a None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c/users/ac0c4e10c4784958ac631e3fc6f2eaa8/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:35.127306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12b381-bec3-4b51-9fe5-f87e6467c19a None admin] RBAC: Authorizing `identity:create_grant(project_id=b76ad539b19f499fa6232d0ca420603c, user_id=ac0c4e10c4784958ac631e3fc6f2eaa8, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:35.128833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12b381-bec3-4b51-9fe5-f87e6467c19a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:35.156523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 109/231] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:34 2022] PUT /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c/users/ac0c4e10c4784958ac631e3fc6f2eaa8/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:35.184198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d8062-d5ad-4e2f-af42-00e87906b395 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:35.198869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:35.239093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3fc2e-8fb3-4371-9d02-80adff859f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:35.239790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3fc2e-8fb3-4371-9d02-80adff859f26 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:35.240067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3fc2e-8fb3-4371-9d02-80adff859f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:35.240340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3fc2e-8fb3-4371-9d02-80adff859f26 None admin] PATH_INFO: `/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:35.241816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3fc2e-8fb3-4371-9d02-80adff859f26 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0c4e10c4784958ac631e3fc6f2eaa8)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:35.243507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3fc2e-8fb3-4371-9d02-80adff859f26 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:35.245762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 123/232] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:35 2022] GET /identity/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:35.255455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12b381-bec3-4b51-9fe5-f87e6467c19a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:35.285503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:35.463599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12b381-bec3-4b51-9fe5-f87e6467c19a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:35.531862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bb9ec-0566-428a-baf9-53b8d327148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:35.532529 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb9ec-0566-428a-baf9-53b8d327148b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:35.532805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb9ec-0566-428a-baf9-53b8d327148b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:35.533073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bb9ec-0566-428a-baf9-53b8d327148b None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:35.538559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bb9ec-0566-428a-baf9-53b8d327148b None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:35.540114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bb9ec-0566-428a-baf9-53b8d327148b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:35.541842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 110/233] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:35 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:35.550599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3fc2e-8fb3-4371-9d02-80adff859f26 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:35.743982 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3fc2e-8fb3-4371-9d02-80adff859f26 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:35.795614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5612037-1bbc-443e-8b84-a93766b13095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:35.796607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5612037-1bbc-443e-8b84-a93766b13095 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:35.797032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5612037-1bbc-443e-8b84-a93766b13095 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:35.797446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5612037-1bbc-443e-8b84-a93766b13095 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c/users/ac0c4e10c4784958ac631e3fc6f2eaa8/roles/0ac8e76ee0884ae1be64093499d4865e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:35.804046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5612037-1bbc-443e-8b84-a93766b13095 None admin] RBAC: Authorizing `identity:create_grant(project_id=b76ad539b19f499fa6232d0ca420603c, user_id=ac0c4e10c4784958ac631e3fc6f2eaa8, role_id=0ac8e76ee0884ae1be64093499d4865e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:35.805860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5612037-1bbc-443e-8b84-a93766b13095 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:35.833454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 124/234] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:35 2022] PUT /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c/users/ac0c4e10c4784958ac631e3fc6f2eaa8/roles/0ac8e76ee0884ae1be64093499d4865e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:36.198084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd10b-3461-42a8-a2c2-0aad30daf8c4 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:36.198928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd10b-3461-42a8-a2c2-0aad30daf8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:36.198928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd10b-3461-42a8-a2c2-0aad30daf8c4 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:36.200527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 111/235] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:36.207944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ca58-c1a1-40ed-85b6-7bfb8390ab6f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:36.208235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ca58-c1a1-40ed-85b6-7bfb8390ab6f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:36.208488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ca58-c1a1-40ed-85b6-7bfb8390ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:36.227604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7758ca58-c1a1-40ed-85b6-7bfb8390ab6f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:36.228809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7758ca58-c1a1-40ed-85b6-7bfb8390ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:36.267582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:36.321957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 125/236] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:36.359483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b08280-ea49-49cf-bd3a-cfc17097c5e9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:36.359806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b08280-ea49-49cf-bd3a-cfc17097c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:36.360018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b08280-ea49-49cf-bd3a-cfc17097c5e9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:36.361803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 112/237] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:36.367290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41142652-42e9-4c12-ba10-af4b8e92cb11 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:36.367595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41142652-42e9-4c12-ba10-af4b8e92cb11 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:36.367839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41142652-42e9-4c12-ba10-af4b8e92cb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:36.392085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-41142652-42e9-4c12-ba10-af4b8e92cb11 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:36.393289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-41142652-42e9-4c12-ba10-af4b8e92cb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:36.494620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 126/238] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:36.730688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b08280-ea49-49cf-bd3a-cfc17097c5e9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:36.833905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:36.862362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b08280-ea49-49cf-bd3a-cfc17097c5e9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:36.869110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41142652-42e9-4c12-ba10-af4b8e92cb11 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:36.916831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a75b2-824d-4b13-aaa9-8defeeb036c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:36.917644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a75b2-824d-4b13-aaa9-8defeeb036c3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:36.917922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a75b2-824d-4b13-aaa9-8defeeb036c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:36.918189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a75b2-824d-4b13-aaa9-8defeeb036c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:36.935790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a75b2-824d-4b13-aaa9-8defeeb036c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-231a75b2-824d-4b13-aaa9-8defeeb036c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:36.941801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:36.942728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:36.943528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 113/239] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:36.949086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a75b2-824d-4b13-aaa9-8defeeb036c3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:37.064860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:37.069862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41142652-42e9-4c12-ba10-af4b8e92cb11 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:37.111018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b54acb-908c-40a0-be47-2dca2407bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:37.111733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54acb-908c-40a0-be47-2dca2407bd31 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.112112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54acb-908c-40a0-be47-2dca2407bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.112480 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54acb-908c-40a0-be47-2dca2407bd31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.113720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b54acb-908c-40a0-be47-2dca2407bd31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:37.115613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b54acb-908c-40a0-be47-2dca2407bd31 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:37.118505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 127/240] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:37.124853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b54acb-908c-40a0-be47-2dca2407bd31 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:37.212764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a75b2-824d-4b13-aaa9-8defeeb036c3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:37.250952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b54acb-908c-40a0-be47-2dca2407bd31 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:37.297092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57916a-b5e3-4102-891c-6916ee57fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:37.298031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57916a-b5e3-4102-891c-6916ee57fdba None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.298439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57916a-b5e3-4102-891c-6916ee57fdba None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.298838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57916a-b5e3-4102-891c-6916ee57fdba None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.299575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57916a-b5e3-4102-891c-6916ee57fdba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:37.301224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57916a-b5e3-4102-891c-6916ee57fdba None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:37.308471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13d760-7b12-4519-865d-9f0d1062b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:37.309332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d760-7b12-4519-865d-9f0d1062b565 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.309778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d760-7b12-4519-865d-9f0d1062b565 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.310181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d760-7b12-4519-865d-9f0d1062b565 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.311023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13d760-7b12-4519-865d-9f0d1062b565 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:37.311468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13d760-7b12-4519-865d-9f0d1062b565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:37.313025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13d760-7b12-4519-865d-9f0d1062b565 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:37.323665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:37.334093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 128/241] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:29:37 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:29:37.341013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 114/242] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:37.347021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57916a-b5e3-4102-891c-6916ee57fdba None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:37.396179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:37.504457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57916a-b5e3-4102-891c-6916ee57fdba None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:37.542801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a43d9-ed6c-4057-987e-ac05934371dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:37.543459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a43d9-ed6c-4057-987e-ac05934371dc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.543739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a43d9-ed6c-4057-987e-ac05934371dc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.544014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a43d9-ed6c-4057-987e-ac05934371dc None admin] PATH_INFO: `/v3/users/77c8f12d58af443991170264b9f39a67` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.560415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a43d9-ed6c-4057-987e-ac05934371dc None admin] RBAC: Authorizing `identity:get_user(user_id=77c8f12d58af443991170264b9f39a67)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:37.561978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a43d9-ed6c-4057-987e-ac05934371dc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:37.564065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 129/243] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:37 2022] GET /identity/v3/users/77c8f12d58af443991170264b9f39a67 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:37.564716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac381dde-53cb-4a84-bc06-8c5c78dc5673 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.565469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac381dde-53cb-4a84-bc06-8c5c78dc5673 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.566182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac381dde-53cb-4a84-bc06-8c5c78dc5673 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.568705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 115/244] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:37.573855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a43d9-ed6c-4057-987e-ac05934371dc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:37.576568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8abb1-7e77-48a9-8184-bd2eee373c80 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.577505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8abb1-7e77-48a9-8184-bd2eee373c80 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.578720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8abb1-7e77-48a9-8184-bd2eee373c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.622221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-eec8abb1-7e77-48a9-8184-bd2eee373c80 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:37.624078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-eec8abb1-7e77-48a9-8184-bd2eee373c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:37.693431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:37.715037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 116/245] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:37.717887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b33f-b625-4194-ab4d-3b9e200cf945 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.718166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b33f-b625-4194-ab4d-3b9e200cf945 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.718474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b33f-b625-4194-ab4d-3b9e200cf945 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.719778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 117/246] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:37.721586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a43d9-ed6c-4057-987e-ac05934371dc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:37.724899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666acdf-a6f2-4108-8617-c9025b9c5a70 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.725185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666acdf-a6f2-4108-8617-c9025b9c5a70 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.725458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666acdf-a6f2-4108-8617-c9025b9c5a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.743968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d666acdf-a6f2-4108-8617-c9025b9c5a70 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:37.744941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d666acdf-a6f2-4108-8617-c9025b9c5a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:37.758353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e61ea-f569-4ffd-b0d3-39a8e2c6422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:37.759421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e61ea-f569-4ffd-b0d3-39a8e2c6422d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:37.759892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e61ea-f569-4ffd-b0d3-39a8e2c6422d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:37.760367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e61ea-f569-4ffd-b0d3-39a8e2c6422d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:37.820110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 118/247] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:37.833293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e61ea-f569-4ffd-b0d3-39a8e2c6422d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:37.835230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e61ea-f569-4ffd-b0d3-39a8e2c6422d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:37.920348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:37.939579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 130/248] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:37.951062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666acdf-a6f2-4108-8617-c9025b9c5a70 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.022828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:38.047595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e61ea-f569-4ffd-b0d3-39a8e2c6422d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.070219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666acdf-a6f2-4108-8617-c9025b9c5a70 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:38.122188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7d0a6-6ac7-4761-9d82-2a91aa253f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:38.122828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d0a6-6ac7-4761-9d82-2a91aa253f90 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.123124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d0a6-6ac7-4761-9d82-2a91aa253f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.123382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d0a6-6ac7-4761-9d82-2a91aa253f90 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.125378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7d0a6-6ac7-4761-9d82-2a91aa253f90 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:38.126881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7d0a6-6ac7-4761-9d82-2a91aa253f90 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:38.128560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 119/249] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:37 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:38.129328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7d0a6-6ac7-4761-9d82-2a91aa253f90 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.180871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e61ea-f569-4ffd-b0d3-39a8e2c6422d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:38.223761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624bec3-4ea3-40cf-8cb8-4dfb1ee0e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:38.224335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624bec3-4ea3-40cf-8cb8-4dfb1ee0e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.224615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624bec3-4ea3-40cf-8cb8-4dfb1ee0e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.224883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624bec3-4ea3-40cf-8cb8-4dfb1ee0e3c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.238820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624bec3-4ea3-40cf-8cb8-4dfb1ee0e3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4624bec3-4ea3-40cf-8cb8-4dfb1ee0e3c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:38.244448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:38.245418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:38.246204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:38.246827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 131/250] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:29:38.247399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624bec3-4ea3-40cf-8cb8-4dfb1ee0e3c2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.263013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7d0a6-6ac7-4761-9d82-2a91aa253f90 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:38.301343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:38.307775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:38.313551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc783-134c-4d2d-8e5d-492beb34ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:38.314716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc783-134c-4d2d-8e5d-492beb34ee43 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.314996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc783-134c-4d2d-8e5d-492beb34ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.315263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc783-134c-4d2d-8e5d-492beb34ee43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.338214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bc783-134c-4d2d-8e5d-492beb34ee43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c65bc783-134c-4d2d-8e5d-492beb34ee43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:38.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:38.354820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:38.355595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:38.357768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 120/251] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:38.358327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc783-134c-4d2d-8e5d-492beb34ee43 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.431215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624bec3-4ea3-40cf-8cb8-4dfb1ee0e3c2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:38.506198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:38.507194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.507650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.508200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.509133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] RBAC: Adding query filter params (role.id=cdc99bb66fcc41f1a2b5ce626fa22557, scope.project.id=b76ad539b19f499fa6232d0ca420603c, user.id=77c8f12d58af443991170264b9f39a67) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:38.509637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:38.511460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:38.522481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 132/252] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:38 2022] GET /identity/v3/role_assignments?user.id=77c8f12d58af443991170264b9f39a67&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=cdc99bb66fcc41f1a2b5ce626fa22557 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:38.523844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.546470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc783-134c-4d2d-8e5d-492beb34ee43 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:38.583538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b402c-bad1-4b60-9328-f90bfb9e1231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:38.584212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b402c-bad1-4b60-9328-f90bfb9e1231 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.584493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b402c-bad1-4b60-9328-f90bfb9e1231 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.585063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b402c-bad1-4b60-9328-f90bfb9e1231 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.585429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b402c-bad1-4b60-9328-f90bfb9e1231 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:38.585729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b402c-bad1-4b60-9328-f90bfb9e1231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:38.587187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b402c-bad1-4b60-9328-f90bfb9e1231 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:38.597092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 121/253] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:38.598918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30767c0-d1db-42ee-886e-58293c5bd6db None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.598918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30767c0-d1db-42ee-886e-58293c5bd6db None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.599121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30767c0-d1db-42ee-886e-58293c5bd6db None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.600737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 122/254] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:38.606309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30767c0-d1db-42ee-886e-58293c5bd6db None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.674207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f65317-f731-4a25-be21-7a42d29e0976 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:38.677990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:38.686967 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:38.748815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30767c0-d1db-42ee-886e-58293c5bd6db None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:38.773097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:38.773707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.773988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.774278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.774964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:38.775271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:38.776960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:38.789803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52492f-891e-4190-ae39-0e4e9775bb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:38.790897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52492f-891e-4190-ae39-0e4e9775bb87 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.791380 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52492f-891e-4190-ae39-0e4e9775bb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.791885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52492f-891e-4190-ae39-0e4e9775bb87 None admin] PATH_INFO: `/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.793299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52492f-891e-4190-ae39-0e4e9775bb87 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0c4e10c4784958ac631e3fc6f2eaa8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:38.796019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52492f-891e-4190-ae39-0e4e9775bb87 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:38.798414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 123/255] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:38 2022] GET /identity/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:38.798648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 133/256] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:38.800139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408d0f-b513-40d9-890f-141699b52534 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:38.800619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408d0f-b513-40d9-890f-141699b52534 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:38.801105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53408d0f-b513-40d9-890f-141699b52534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:38.804247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.835439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-53408d0f-b513-40d9-890f-141699b52534 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:38.836718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-53408d0f-b513-40d9-890f-141699b52534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:38.962005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 124/257] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:38.963463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53408d0f-b513-40d9-890f-141699b52534 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:38.988668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660efafb-600f-46b9-b0da-d7f26dac01f6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:39.022887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:39.075768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea373aa-a956-4922-8815-960f3a27c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:39.076412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea373aa-a956-4922-8815-960f3a27c387 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:39.076691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea373aa-a956-4922-8815-960f3a27c387 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:39.076958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea373aa-a956-4922-8815-960f3a27c387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:39.090308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53408d0f-b513-40d9-890f-141699b52534 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:39.142659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:39.182331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea373aa-a956-4922-8815-960f3a27c387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:39.184050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea373aa-a956-4922-8815-960f3a27c387 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:39.196104 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4b3ba-cfe2-41a4-8162-1cb11f3b80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:39.197183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4b3ba-cfe2-41a4-8162-1cb11f3b80f4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:39.197653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4b3ba-cfe2-41a4-8162-1cb11f3b80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:39.198219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4b3ba-cfe2-41a4-8162-1cb11f3b80f4 None admin] PATH_INFO: `/v3/users/f8bfe6b4e2f24f219f944efe3df017d4` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:39.199762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4b3ba-cfe2-41a4-8162-1cb11f3b80f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f8bfe6b4e2f24f219f944efe3df017d4)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:39.201564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4b3ba-cfe2-41a4-8162-1cb11f3b80f4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:39.204304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 125/258] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:38 2022] GET /identity/v3/users/f8bfe6b4e2f24f219f944efe3df017d4 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:39.211350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4b3ba-cfe2-41a4-8162-1cb11f3b80f4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:39.307422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 134/259] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:29:39.309768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea373aa-a956-4922-8815-960f3a27c387 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:39.402921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:39.433044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea373aa-a956-4922-8815-960f3a27c387 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:39.477030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec54c1b-a968-4173-817d-b5fa4bd066cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:39.477687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec54c1b-a968-4173-817d-b5fa4bd066cd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:39.477955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec54c1b-a968-4173-817d-b5fa4bd066cd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:39.478220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec54c1b-a968-4173-817d-b5fa4bd066cd None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:39.480895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec54c1b-a968-4173-817d-b5fa4bd066cd None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:39.482394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec54c1b-a968-4173-817d-b5fa4bd066cd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:39.493663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 135/260] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:39 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:39.494658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec54c1b-a968-4173-817d-b5fa4bd066cd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:39.516425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4b3ba-cfe2-41a4-8162-1cb11f3b80f4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:39.566761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:39.602486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0eb27-ecae-4abd-9f4f-bf8f7e9f5a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:39.603131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0eb27-ecae-4abd-9f4f-bf8f7e9f5a37 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:39.603406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0eb27-ecae-4abd-9f4f-bf8f7e9f5a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:39.603668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0eb27-ecae-4abd-9f4f-bf8f7e9f5a37 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:39.604966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0eb27-ecae-4abd-9f4f-bf8f7e9f5a37 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:39.606954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0eb27-ecae-4abd-9f4f-bf8f7e9f5a37 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:39.608658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 126/261] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:39 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:39.609552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0eb27-ecae-4abd-9f4f-bf8f7e9f5a37 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:39.636716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec54c1b-a968-4173-817d-b5fa4bd066cd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:39.676566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585a091-42a0-4e19-a9f3-4a2c124f5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:39.677121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a091-42a0-4e19-a9f3-4a2c124f5f12 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:39.677395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a091-42a0-4e19-a9f3-4a2c124f5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:39.677659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585a091-42a0-4e19-a9f3-4a2c124f5f12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:39.679668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:39.695202 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585a091-42a0-4e19-a9f3-4a2c124f5f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-f585a091-42a0-4e19-a9f3-4a2c124f5f12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:39.701052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:39.701942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:39.702729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 136/262] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:29:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:39.704619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585a091-42a0-4e19-a9f3-4a2c124f5f12 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:39.784162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0eb27-ecae-4abd-9f4f-bf8f7e9f5a37 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:39.821372 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:39.822087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:39.822455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:39.822787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:39.824125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=b76ad539b19f499fa6232d0ca420603c, user.id=ac0c4e10c4784958ac631e3fc6f2eaa8) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:39.824728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:39.826443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:39.833662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 127/263] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:39 2022] GET /identity/v3/role_assignments?user.id=ac0c4e10c4784958ac631e3fc6f2eaa8&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:39.839901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:39.954868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:39.955821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585a091-42a0-4e19-a9f3-4a2c124f5f12 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:40.043372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7591f9-7f89-4fd6-b1f2-3ab61f288684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:40.044108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7591f9-7f89-4fd6-b1f2-3ab61f288684 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:40.044363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7591f9-7f89-4fd6-b1f2-3ab61f288684 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:40.044637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7591f9-7f89-4fd6-b1f2-3ab61f288684 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c/users/f8bfe6b4e2f24f219f944efe3df017d4/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:40.047862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7591f9-7f89-4fd6-b1f2-3ab61f288684 None admin] RBAC: Authorizing `identity:create_grant(project_id=b76ad539b19f499fa6232d0ca420603c, user_id=f8bfe6b4e2f24f219f944efe3df017d4, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:40.049398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7591f9-7f89-4fd6-b1f2-3ab61f288684 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:40.075352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 137/264] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:39 2022] PUT /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c/users/f8bfe6b4e2f24f219f944efe3df017d4/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:40.085900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996efb-a46f-428a-a4f4-3a4693db6fa6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:40.128059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:40.128713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:40.129038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:40.129314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:40.130017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:40.130316 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:40.131904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:40.142015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 128/265] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:29:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:40.148223 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7591f9-7f89-4fd6-b1f2-3ab61f288684 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:40.231378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:40.287234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7591f9-7f89-4fd6-b1f2-3ab61f288684 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:40.331443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22780a8-546f-4f6c-a579-700b552a4769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:40.332111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22780a8-546f-4f6c-a579-700b552a4769 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:40.332390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22780a8-546f-4f6c-a579-700b552a4769 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:40.332652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22780a8-546f-4f6c-a579-700b552a4769 None admin] PATH_INFO: `/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:40.338185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22780a8-546f-4f6c-a579-700b552a4769 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0c4e10c4784958ac631e3fc6f2eaa8)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:40.339961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22780a8-546f-4f6c-a579-700b552a4769 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:40.342054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 138/266] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:40 2022] GET /identity/v3/users/ac0c4e10c4784958ac631e3fc6f2eaa8 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:40.348264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:40.404658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f66d3-e27e-40a5-b789-286ca9909d39 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:40.405303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f66d3-e27e-40a5-b789-286ca9909d39 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:40.405775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f66d3-e27e-40a5-b789-286ca9909d39 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:40.408427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 139/267] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:40.416226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ae72-2068-4d20-ac07-0fce69e3686c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:40.416822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ae72-2068-4d20-ac07-0fce69e3686c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:40.417521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ae72-2068-4d20-ac07-0fce69e3686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:40.443084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-31e2ae72-2068-4d20-ac07-0fce69e3686c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:40.444347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-31e2ae72-2068-4d20-ac07-0fce69e3686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:40.496938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db265d7-02d8-4974-9fe3-32383331417d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:40.510182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:40.551780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f33bf3-1464-4641-8260-5a06ebc0a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:40.552702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33bf3-1464-4641-8260-5a06ebc0a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:40.552702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33bf3-1464-4641-8260-5a06ebc0a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:40.552994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f33bf3-1464-4641-8260-5a06ebc0a9b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:40.579150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 140/268] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:40.602054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf531ec-a5e3-450b-b276-5efd646fb233 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:40.602370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf531ec-a5e3-450b-b276-5efd646fb233 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:40.602634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf531ec-a5e3-450b-b276-5efd646fb233 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:40.604794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 141/269] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:40.609663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519545f-5da6-4c8d-ab8a-14373b93d6af None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:40.610017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519545f-5da6-4c8d-ab8a-14373b93d6af None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:40.610243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519545f-5da6-4c8d-ab8a-14373b93d6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:40.644900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d519545f-5da6-4c8d-ab8a-14373b93d6af None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:40.647601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d519545f-5da6-4c8d-ab8a-14373b93d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:40.705336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f33bf3-1464-4641-8260-5a06ebc0a9b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:40.706934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f33bf3-1464-4641-8260-5a06ebc0a9b7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:40.747933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:40.788636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 142/270] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:40.938280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 129/271] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:40.944389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519545f-5da6-4c8d-ab8a-14373b93d6af None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:40.954355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f33bf3-1464-4641-8260-5a06ebc0a9b7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:40.982675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:41.153335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f33bf3-1464-4641-8260-5a06ebc0a9b7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:41.155965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519545f-5da6-4c8d-ab8a-14373b93d6af None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:41.191166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab370d3f-1c8a-4b58-b978-ea2cf25c4350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:41.191819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab370d3f-1c8a-4b58-b978-ea2cf25c4350 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.192098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab370d3f-1c8a-4b58-b978-ea2cf25c4350 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.192370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab370d3f-1c8a-4b58-b978-ea2cf25c4350 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.204355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab370d3f-1c8a-4b58-b978-ea2cf25c4350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ab370d3f-1c8a-4b58-b978-ea2cf25c4350 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:41.209424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:41.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 130/272] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:29:41.212809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab370d3f-1c8a-4b58-b978-ea2cf25c4350 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:41.230103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7413f-0e52-4735-b2a2-25c1f57ff0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:41.231778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7413f-0e52-4735-b2a2-25c1f57ff0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.232569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7413f-0e52-4735-b2a2-25c1f57ff0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.233436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7413f-0e52-4735-b2a2-25c1f57ff0b2 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.235993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7413f-0e52-4735-b2a2-25c1f57ff0b2 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:41.239358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7413f-0e52-4735-b2a2-25c1f57ff0b2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:41.243368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 143/273] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:40 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:41.245394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7413f-0e52-4735-b2a2-25c1f57ff0b2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:41.314669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:41.321638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:41.372100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab370d3f-1c8a-4b58-b978-ea2cf25c4350 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:41.383105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7413f-0e52-4735-b2a2-25c1f57ff0b2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:41.422580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1ffb-c38e-427b-b6c5-8bad13202c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:41.423246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1ffb-c38e-427b-b6c5-8bad13202c82 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.423525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1ffb-c38e-427b-b6c5-8bad13202c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.423796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1ffb-c38e-427b-b6c5-8bad13202c82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.424934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c1ffb-c38e-427b-b6c5-8bad13202c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:41.426451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c1ffb-c38e-427b-b6c5-8bad13202c82 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:41.428094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 131/274] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:41.428903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1ffb-c38e-427b-b6c5-8bad13202c82 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:41.451935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87ea5f-0acc-44a3-8145-6f65b3200f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:41.452573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87ea5f-0acc-44a3-8145-6f65b3200f9b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.452845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87ea5f-0acc-44a3-8145-6f65b3200f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.453115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87ea5f-0acc-44a3-8145-6f65b3200f9b None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.454146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87ea5f-0acc-44a3-8145-6f65b3200f9b None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:41.454689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87ea5f-0acc-44a3-8145-6f65b3200f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:41.455885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87ea5f-0acc-44a3-8145-6f65b3200f9b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:41.464799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 144/275] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:41.470786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea2482-81c1-4994-b23b-c993e61fda59 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.471359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea2482-81c1-4994-b23b-c993e61fda59 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.471537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea2482-81c1-4994-b23b-c993e61fda59 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.474430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 145/276] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:41.474430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea2482-81c1-4994-b23b-c993e61fda59 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:41.588618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1ffb-c38e-427b-b6c5-8bad13202c82 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:41.641237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea2482-81c1-4994-b23b-c993e61fda59 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:41.643319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:41.644271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.644722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.645102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.646172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] RBAC: Adding query filter params (role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=b76ad539b19f499fa6232d0ca420603c, user.id=ac0c4e10c4784958ac631e3fc6f2eaa8) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:41.646704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:41.649209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:41.666588 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 132/277] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:41 2022] GET /identity/v3/role_assignments?user.id=ac0c4e10c4784958ac631e3fc6f2eaa8&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:41.666588 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:41.666588 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:41.676114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:41.712965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd91553-7e97-4822-801e-4c08cd5ec74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:41.713605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd91553-7e97-4822-801e-4c08cd5ec74a None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.713994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd91553-7e97-4822-801e-4c08cd5ec74a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.714274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd91553-7e97-4822-801e-4c08cd5ec74a None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.715105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd91553-7e97-4822-801e-4c08cd5ec74a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:41.716835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd91553-7e97-4822-801e-4c08cd5ec74a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:41.750937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 146/278] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:29:41 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:41.752706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861abce-4ee6-4fbe-820a-dbd60d764214 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.752993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861abce-4ee6-4fbe-820a-dbd60d764214 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.753269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861abce-4ee6-4fbe-820a-dbd60d764214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.780440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b861abce-4ee6-4fbe-820a-dbd60d764214 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:41.781544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b861abce-4ee6-4fbe-820a-dbd60d764214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:41.862011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 147/279] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:41.897532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4f27-a3e1-4191-8dec-9bc232a5336b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:41.942562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b516d3-bb6e-433b-8c0d-02a0b82af1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:41.943144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b516d3-bb6e-433b-8c0d-02a0b82af1be None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:41.943426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b516d3-bb6e-433b-8c0d-02a0b82af1be None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:41.943700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b516d3-bb6e-433b-8c0d-02a0b82af1be None admin] PATH_INFO: `/v3/users/e5449b4419254492a18770caac520c9d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:41.960187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b516d3-bb6e-433b-8c0d-02a0b82af1be None admin] RBAC: Authorizing `identity:get_user(user_id=e5449b4419254492a18770caac520c9d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:41.961730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b516d3-bb6e-433b-8c0d-02a0b82af1be None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:41.964299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 133/280] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:41 2022] GET /identity/v3/users/e5449b4419254492a18770caac520c9d => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:41.970430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861abce-4ee6-4fbe-820a-dbd60d764214 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:42.094838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:42.099354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861abce-4ee6-4fbe-820a-dbd60d764214 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:42.150907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:42.151596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:42.152296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:42.152296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:42.152838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] RBAC: Adding query filter params (role.id=2284ec91b47444249d339c70801cd407, user.id=e5449b4419254492a18770caac520c9d, scope.system=all) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:42.153145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:42.154663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:42.165573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 148/281] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Aug 30 14:29:41 2022] GET /identity/v3/role_assignments?user.id=e5449b4419254492a18770caac520c9d&scope.system=all&role.id=2284ec91b47444249d339c70801cd407 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:42.419338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b516d3-bb6e-433b-8c0d-02a0b82af1be None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:42.553533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:42.653055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b516d3-bb6e-433b-8c0d-02a0b82af1be None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:42.730307 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210580e-80b5-4ac8-be32-bc4a022fdf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:42.731342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210580e-80b5-4ac8-be32-bc4a022fdf1f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:42.731830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210580e-80b5-4ac8-be32-bc4a022fdf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:42.732313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210580e-80b5-4ac8-be32-bc4a022fdf1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:42.757323 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210580e-80b5-4ac8-be32-bc4a022fdf1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-4210580e-80b5-4ac8-be32-bc4a022fdf1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:42.767679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:42.768664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:42.769445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:42.775764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 134/282] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:29:42.784234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:42.937475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a474-2e06-4d08-bdbc-d2191ca885a5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:42.991349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:42.992411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:42.992890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:42.993354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:42.994238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:42.994766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:42.996866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:43.011456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 149/283] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:43.021333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210580e-80b5-4ac8-be32-bc4a022fdf1f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:43.247712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210580e-80b5-4ac8-be32-bc4a022fdf1f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:43.301614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:43.339444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af30f7-ab79-45c7-bd73-3e34a27a4da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:43.340548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af30f7-ab79-45c7-bd73-3e34a27a4da6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:43.341027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af30f7-ab79-45c7-bd73-3e34a27a4da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:43.341509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af30f7-ab79-45c7-bd73-3e34a27a4da6 None admin] PATH_INFO: `/v3/users/77c8f12d58af443991170264b9f39a67` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:43.347670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af30f7-ab79-45c7-bd73-3e34a27a4da6 None admin] RBAC: Authorizing `identity:get_user(user_id=77c8f12d58af443991170264b9f39a67)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:43.350464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af30f7-ab79-45c7-bd73-3e34a27a4da6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:43.353958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 135/284] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:43 2022] GET /identity/v3/users/77c8f12d58af443991170264b9f39a67 => generated 297 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:43.362742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:43.433417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:43.445192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5d2f-5d82-4e1c-9032-1d56c681c076 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:43.445627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5d2f-5d82-4e1c-9032-1d56c681c076 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:43.446046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f5d2f-5d82-4e1c-9032-1d56c681c076 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:43.449775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 136/285] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:43.460687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604ada-fcdc-415e-80d5-af6306712ef7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:43.461113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604ada-fcdc-415e-80d5-af6306712ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:43.464571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b604ada-fcdc-415e-80d5-af6306712ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:43.528123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7b604ada-fcdc-415e-80d5-af6306712ef7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:43.529911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7b604ada-fcdc-415e-80d5-af6306712ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:43.597315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be11d4-638d-4c85-98aa-83002eba2b1e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:43.675159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b9807-2c7b-4930-a91a-e8aeb2776140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:43.675814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9807-2c7b-4930-a91a-e8aeb2776140 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:43.676092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9807-2c7b-4930-a91a-e8aeb2776140 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:43.676356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b9807-2c7b-4930-a91a-e8aeb2776140 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:43.680970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 137/286] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:43.681703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b9807-2c7b-4930-a91a-e8aeb2776140 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:43.683372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b9807-2c7b-4930-a91a-e8aeb2776140 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:43.685708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 150/287] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:43 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:43.693993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b604ada-fcdc-415e-80d5-af6306712ef7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:43.856640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b604ada-fcdc-415e-80d5-af6306712ef7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:43.883077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:43.909711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c4bb8-289f-4217-9a02-bf3413b0b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:43.910440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4bb8-289f-4217-9a02-bf3413b0b907 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:43.910732 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4bb8-289f-4217-9a02-bf3413b0b907 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:43.911012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4bb8-289f-4217-9a02-bf3413b0b907 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c/users/77c8f12d58af443991170264b9f39a67/roles/cdc99bb66fcc41f1a2b5ce626fa22557` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:43.919319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c4bb8-289f-4217-9a02-bf3413b0b907 None admin] RBAC: Authorizing `identity:create_grant(project_id=b76ad539b19f499fa6232d0ca420603c, user_id=77c8f12d58af443991170264b9f39a67, role_id=cdc99bb66fcc41f1a2b5ce626fa22557)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:43.920811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c4bb8-289f-4217-9a02-bf3413b0b907 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:43.939833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 138/288] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:29:43 2022] PUT /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c/users/77c8f12d58af443991170264b9f39a67/roles/cdc99bb66fcc41f1a2b5ce626fa22557 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:44.057685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b9807-2c7b-4930-a91a-e8aeb2776140 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:44.192463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:44.204491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b9807-2c7b-4930-a91a-e8aeb2776140 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:44.253134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327d07-2cba-4c9b-aba4-9e51d641aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:44.253807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327d07-2cba-4c9b-aba4-9e51d641aead None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:44.254086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327d07-2cba-4c9b-aba4-9e51d641aead None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:44.254357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327d07-2cba-4c9b-aba4-9e51d641aead None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:44.267940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80327d07-2cba-4c9b-aba4-9e51d641aead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-80327d07-2cba-4c9b-aba4-9e51d641aead None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:44.274334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:44.275359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:44.276281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:44.278848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 151/289] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:44.282966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c4bb8-289f-4217-9a02-bf3413b0b907 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:44.392112 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c4bb8-289f-4217-9a02-bf3413b0b907 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:44.429023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373003a-5f5c-479c-a7db-bef21c39b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:44.429655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373003a-5f5c-479c-a7db-bef21c39b556 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:44.429928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373003a-5f5c-479c-a7db-bef21c39b556 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:44.430196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373003a-5f5c-479c-a7db-bef21c39b556 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:44.430907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373003a-5f5c-479c-a7db-bef21c39b556 None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:44.431206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373003a-5f5c-479c-a7db-bef21c39b556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:44.432728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373003a-5f5c-479c-a7db-bef21c39b556 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:44.443424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 139/290] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:44.449666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327d07-2cba-4c9b-aba4-9e51d641aead None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:44.564643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327d07-2cba-4c9b-aba4-9e51d641aead None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:44.575740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6f15-bcf0-44c1-b991-952d1fc6d0a7 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:44.576053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6f15-bcf0-44c1-b991-952d1fc6d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:44.576302 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6f15-bcf0-44c1-b991-952d1fc6d0a7 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:44.579454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 140/291] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:29:44.584084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c9f97-a6a4-4cb5-8878-68781595ae27 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:44.584500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c9f97-a6a4-4cb5-8878-68781595ae27 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:44.584784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c9f97-a6a4-4cb5-8878-68781595ae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:44.603538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c9e37-2130-4c9a-b573-5d44c5ca7d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:44.604388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9e37-2130-4c9a-b573-5d44c5ca7d7c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:44.604564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-282c9f97-a6a4-4cb5-8878-68781595ae27 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:44.604702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9e37-2130-4c9a-b573-5d44c5ca7d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:44.604935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9e37-2130-4c9a-b573-5d44c5ca7d7c None admin] PATH_INFO: `/v3/users/f8bfe6b4e2f24f219f944efe3df017d4` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:44.606008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-282c9f97-a6a4-4cb5-8878-68781595ae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:44.606282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c9e37-2130-4c9a-b573-5d44c5ca7d7c None admin] RBAC: Authorizing `identity:get_user(user_id=f8bfe6b4e2f24f219f944efe3df017d4)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:44.607827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c9e37-2130-4c9a-b573-5d44c5ca7d7c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:44.611051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 152/292] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:44 2022] GET /identity/v3/users/f8bfe6b4e2f24f219f944efe3df017d4 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:44.617061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c9e37-2130-4c9a-b573-5d44c5ca7d7c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:44.654841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:44.733091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c9e37-2130-4c9a-b573-5d44c5ca7d7c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:44.772128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:44.772998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79ed37-5a15-4628-95a8-2d78875449c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:44.774817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79ed37-5a15-4628-95a8-2d78875449c2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:44.775302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79ed37-5a15-4628-95a8-2d78875449c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:44.775712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79ed37-5a15-4628-95a8-2d78875449c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:44.857463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 141/293] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:44.883553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79ed37-5a15-4628-95a8-2d78875449c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:44.885066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79ed37-5a15-4628-95a8-2d78875449c2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:44.909084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:45.026843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 153/294] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:29:45.028750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c9f97-a6a4-4cb5-8878-68781595ae27 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:45.160849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79ed37-5a15-4628-95a8-2d78875449c2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:45.168432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c9f97-a6a4-4cb5-8878-68781595ae27 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:45.259787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fe33d-9f60-4ade-ba70-928c5a272808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:45.261054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fe33d-9f60-4ade-ba70-928c5a272808 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:45.261546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fe33d-9f60-4ade-ba70-928c5a272808 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:45.262098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fe33d-9f60-4ade-ba70-928c5a272808 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:45.267305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fe33d-9f60-4ade-ba70-928c5a272808 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:45.269206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fe33d-9f60-4ade-ba70-928c5a272808 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:45.271317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 142/295] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:45 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:45.286131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fe33d-9f60-4ade-ba70-928c5a272808 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:45.345402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:45.349792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79ed37-5a15-4628-95a8-2d78875449c2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:45.389377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:45.419069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fe33d-9f60-4ade-ba70-928c5a272808 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:45.419465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452e12b-fdfd-418b-927d-ef07b57e6dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:45.420433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452e12b-fdfd-418b-927d-ef07b57e6dbd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:45.420722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452e12b-fdfd-418b-927d-ef07b57e6dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:45.421535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452e12b-fdfd-418b-927d-ef07b57e6dbd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:45.436433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452e12b-fdfd-418b-927d-ef07b57e6dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-6452e12b-fdfd-418b-927d-ef07b57e6dbd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:45.442932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:45.443995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:45.444945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:45.447243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 154/296] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:45.450399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13389-58ea-43ba-b52c-b86a0abfc176 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:45.451332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13389-58ea-43ba-b52c-b86a0abfc176 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:45.451735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13389-58ea-43ba-b52c-b86a0abfc176 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:45.454302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 155/297] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:45.456044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cc2b-669d-46a8-ac10-b6dbb4a3f88a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:45.456486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cc2b-669d-46a8-ac10-b6dbb4a3f88a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:45.456900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06cc2b-669d-46a8-ac10-b6dbb4a3f88a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:45.459226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 156/298] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:45.460121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06cc2b-669d-46a8-ac10-b6dbb4a3f88a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:45.476422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d8353-0ff9-4743-8da0-e591eae06642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:45.477480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8353-0ff9-4743-8da0-e591eae06642 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:45.478266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8353-0ff9-4743-8da0-e591eae06642 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:45.478495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8353-0ff9-4743-8da0-e591eae06642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:45.479910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d8353-0ff9-4743-8da0-e591eae06642 None admin] RBAC: Adding query filter params (role.id=2284ec91b47444249d339c70801cd407, scope.project.id=b76ad539b19f499fa6232d0ca420603c, user.id=f8bfe6b4e2f24f219f944efe3df017d4) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:45.480479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d8353-0ff9-4743-8da0-e591eae06642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:45.483176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d8353-0ff9-4743-8da0-e591eae06642 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:45.493881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 143/299] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:45 2022] GET /identity/v3/role_assignments?user.id=f8bfe6b4e2f24f219f944efe3df017d4&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=2284ec91b47444249d339c70801cd407 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:45.496149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d23c3-be02-4153-9b02-cf5cafacba1a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:45.496539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d23c3-be02-4153-9b02-cf5cafacba1a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:45.496906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d23c3-be02-4153-9b02-cf5cafacba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:45.520683 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-da1d23c3-be02-4153-9b02-cf5cafacba1a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:45.522418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-da1d23c3-be02-4153-9b02-cf5cafacba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:45.642946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 144/300] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:45.644666 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f4e2-fa40-4351-b89a-1782233690c3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:45.645162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f4e2-fa40-4351-b89a-1782233690c3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:45.645653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f4e2-fa40-4351-b89a-1782233690c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:45.674430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f159f4e2-fa40-4351-b89a-1782233690c3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:45.676335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f159f4e2-fa40-4351-b89a-1782233690c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:45.677083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06cc2b-669d-46a8-ac10-b6dbb4a3f88a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:45.739973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:45.767248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:45.768917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:45.769725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:45.770483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:45.772012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:45.772584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:45.775066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:45.789112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 157/301] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:45.798253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:45.817162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 145/302] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:45.879556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:45.964251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159f4e2-fa40-4351-b89a-1782233690c3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:45.981459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c93ed-2520-42cb-b35f-5b221ecacffb None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:46.045007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fbd20-fb21-4ebf-b3de-cc980e61a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:46.045667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fbd20-fb21-4ebf-b3de-cc980e61a385 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.045941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fbd20-fb21-4ebf-b3de-cc980e61a385 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.046209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fbd20-fb21-4ebf-b3de-cc980e61a385 None admin] PATH_INFO: `/v3/users/d23268dcf19345bd90d6d9c5e0d7c9ed` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.062803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fbd20-fb21-4ebf-b3de-cc980e61a385 None admin] RBAC: Authorizing `identity:get_user(user_id=d23268dcf19345bd90d6d9c5e0d7c9ed)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:46.064298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fbd20-fb21-4ebf-b3de-cc980e61a385 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:46.071224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 158/303] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:45 2022] GET /identity/v3/users/d23268dcf19345bd90d6d9c5e0d7c9ed => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:46.072610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fbd20-fb21-4ebf-b3de-cc980e61a385 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:46.114808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159f4e2-fa40-4351-b89a-1782233690c3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:46.155108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cd244-a394-4940-bddb-a2343603a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:46.156240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cd244-a394-4940-bddb-a2343603a563 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.156738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cd244-a394-4940-bddb-a2343603a563 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.157236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cd244-a394-4940-bddb-a2343603a563 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.173305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cd244-a394-4940-bddb-a2343603a563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-2c0cd244-a394-4940-bddb-a2343603a563 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:46.178340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:46.184410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 146/304] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:29:46.185413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cd244-a394-4940-bddb-a2343603a563 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:46.202568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:46.211529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fbd20-fb21-4ebf-b3de-cc980e61a385 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:46.225136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:46.257155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:46.257779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.258050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.258313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.259096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] RBAC: Adding query filter params (role.id=cdc99bb66fcc41f1a2b5ce626fa22557, user.id=d23268dcf19345bd90d6d9c5e0d7c9ed, scope.system=all) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:46.259373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:46.260927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:46.267229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 159/305] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Aug 30 14:29:46 2022] GET /identity/v3/role_assignments?user.id=d23268dcf19345bd90d6d9c5e0d7c9ed&scope.system=all&role.id=cdc99bb66fcc41f1a2b5ce626fa22557 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:46.277221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:46.332303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cd244-a394-4940-bddb-a2343603a563 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:46.405489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aca7a-3bd4-4250-b61e-9efe5a94b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:46.407321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aca7a-3bd4-4250-b61e-9efe5a94b4cc None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.407639 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aca7a-3bd4-4250-b61e-9efe5a94b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.411835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aca7a-3bd4-4250-b61e-9efe5a94b4cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.411835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aca7a-3bd4-4250-b61e-9efe5a94b4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:46.412590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aca7a-3bd4-4250-b61e-9efe5a94b4cc None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:46.418900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 147/306] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:46.427028 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aca7a-3bd4-4250-b61e-9efe5a94b4cc None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:46.468115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5911084-e526-4c06-817f-0f4ff05f79cc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:46.532667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9bde-610a-4972-96d7-5146d73d744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:46.533657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9bde-610a-4972-96d7-5146d73d744f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.534269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9bde-610a-4972-96d7-5146d73d744f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.534860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9bde-610a-4972-96d7-5146d73d744f None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.536164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a9bde-610a-4972-96d7-5146d73d744f None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:46.536658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a9bde-610a-4972-96d7-5146d73d744f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:46.539620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a9bde-610a-4972-96d7-5146d73d744f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:46.558806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 160/307] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:46.560658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5439f5-5ac9-4d1f-b5c5-70debe7e0962 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.561070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5439f5-5ac9-4d1f-b5c5-70debe7e0962 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.561459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5439f5-5ac9-4d1f-b5c5-70debe7e0962 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.563568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 161/308] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:46.565252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5439f5-5ac9-4d1f-b5c5-70debe7e0962 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:46.591643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:46.608205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:46.609704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aca7a-3bd4-4250-b61e-9efe5a94b4cc None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:46.660409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1b662-a337-4912-8333-db3744be985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:46.661234 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1b662-a337-4912-8333-db3744be985b None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.661646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1b662-a337-4912-8333-db3744be985b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.662089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1b662-a337-4912-8333-db3744be985b None admin] PATH_INFO: `/v3/groups` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.663093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1b662-a337-4912-8333-db3744be985b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:46.664857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1b662-a337-4912-8333-db3744be985b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:46.694522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 148/309] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Aug 30 14:29:46 2022] POST /identity/v3/groups => generated 229 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:29:46.700176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eaa79-a3a2-4d23-8b66-18e3297738fb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.700523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eaa79-a3a2-4d23-8b66-18e3297738fb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.700719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eaa79-a3a2-4d23-8b66-18e3297738fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.717623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5439f5-5ac9-4d1f-b5c5-70debe7e0962 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:46.739501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b68eaa79-a3a2-4d23-8b66-18e3297738fb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:46.739501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b68eaa79-a3a2-4d23-8b66-18e3297738fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:46.785403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f351c8-a770-4608-b94e-1e3656c02df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:46.787476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f351c8-a770-4608-b94e-1e3656c02df1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:46.788290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f351c8-a770-4608-b94e-1e3656c02df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:46.788779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f351c8-a770-4608-b94e-1e3656c02df1 None admin] PATH_INFO: `/v3/users/e5449b4419254492a18770caac520c9d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:46.791328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f351c8-a770-4608-b94e-1e3656c02df1 None admin] RBAC: Authorizing `identity:get_user(user_id=e5449b4419254492a18770caac520c9d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:46.795690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f351c8-a770-4608-b94e-1e3656c02df1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:46.798747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 162/310] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:46 2022] GET /identity/v3/users/e5449b4419254492a18770caac520c9d => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:46.806505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f351c8-a770-4608-b94e-1e3656c02df1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:46.883959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 149/311] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:46.982480 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:47.001937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f351c8-a770-4608-b94e-1e3656c02df1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:47.068696 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc025597-b914-4dcb-8c7e-d21f1506a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:47.074472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc025597-b914-4dcb-8c7e-d21f1506a289 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:47.074472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc025597-b914-4dcb-8c7e-d21f1506a289 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:47.074472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc025597-b914-4dcb-8c7e-d21f1506a289 None admin] PATH_INFO: `/v3/system/users/e5449b4419254492a18770caac520c9d/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:47.074472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc025597-b914-4dcb-8c7e-d21f1506a289 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e5449b4419254492a18770caac520c9d, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:47.078988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc025597-b914-4dcb-8c7e-d21f1506a289 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:47.093317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 163/312] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Aug 30 14:29:46 2022] PUT /identity/v3/system/users/e5449b4419254492a18770caac520c9d/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:29:47.212999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68eaa79-a3a2-4d23-8b66-18e3297738fb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:47.390748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:47.418969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68eaa79-a3a2-4d23-8b66-18e3297738fb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:47.461525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdac27-8468-43c9-b3f9-b5cc948e13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:47.462510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdac27-8468-43c9-b3f9-b5cc948e13d1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:47.462997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdac27-8468-43c9-b3f9-b5cc948e13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:47.463283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdac27-8468-43c9-b3f9-b5cc948e13d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:47.476903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdac27-8468-43c9-b3f9-b5cc948e13d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-fcfdac27-8468-43c9-b3f9-b5cc948e13d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:47.482716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:47.484287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:47.485622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 150/313] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:47.496348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc025597-b914-4dcb-8c7e-d21f1506a289 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:47.632500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc025597-b914-4dcb-8c7e-d21f1506a289 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:47.691560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:47.692119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:47.692404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:47.692682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:47.693385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:47.693692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:47.696818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:47.710417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 164/314] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:47.724112 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdac27-8468-43c9-b3f9-b5cc948e13d1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:47.880399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdac27-8468-43c9-b3f9-b5cc948e13d1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:47.931198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb1996-71ce-4487-ac5e-29bf785ea76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:47.933070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb1996-71ce-4487-ac5e-29bf785ea76c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:47.933754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb1996-71ce-4487-ac5e-29bf785ea76c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:47.934272 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb1996-71ce-4487-ac5e-29bf785ea76c None admin] PATH_INFO: `/v3/users/77c8f12d58af443991170264b9f39a67` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:47.935922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb1996-71ce-4487-ac5e-29bf785ea76c None admin] RBAC: Authorizing `identity:get_user(user_id=77c8f12d58af443991170264b9f39a67)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:47.937637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb1996-71ce-4487-ac5e-29bf785ea76c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:47.940000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 151/315] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:47 2022] GET /identity/v3/users/77c8f12d58af443991170264b9f39a67 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:47.947704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:47.975543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:48.101951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87ae6-4886-4820-aad1-7aeb63392dd5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:48.141103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a05af-d6a1-4021-963d-01458ea513da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:48.141736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a05af-d6a1-4021-963d-01458ea513da None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:48.142015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a05af-d6a1-4021-963d-01458ea513da None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:48.142284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a05af-d6a1-4021-963d-01458ea513da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:48.221587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a05af-d6a1-4021-963d-01458ea513da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:48.223006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a05af-d6a1-4021-963d-01458ea513da None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:48.245901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:48.336918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 165/316] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:48.343302 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb1996-71ce-4487-ac5e-29bf785ea76c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:48.372129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:48.463946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb1996-71ce-4487-ac5e-29bf785ea76c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:48.508799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008368-b16e-4c90-bf64-6f6a5ea967a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:48.509897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008368-b16e-4c90-bf64-6f6a5ea967a9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:48.510659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008368-b16e-4c90-bf64-6f6a5ea967a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:48.511332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008368-b16e-4c90-bf64-6f6a5ea967a9 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:48.512864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008368-b16e-4c90-bf64-6f6a5ea967a9 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:48.514567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008368-b16e-4c90-bf64-6f6a5ea967a9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:48.516759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 152/317] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:48 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:48.523727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a05af-d6a1-4021-963d-01458ea513da None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:48.645655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a05af-d6a1-4021-963d-01458ea513da None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:48.668570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:48.685031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc5e3c-46f2-4ed3-91c1-f522d2aea784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:48.685713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc5e3c-46f2-4ed3-91c1-f522d2aea784 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:48.685993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc5e3c-46f2-4ed3-91c1-f522d2aea784 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:48.686260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc5e3c-46f2-4ed3-91c1-f522d2aea784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:48.687024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc5e3c-46f2-4ed3-91c1-f522d2aea784 None admin] RBAC: Adding query filter params (role.id=cdc99bb66fcc41f1a2b5ce626fa22557, scope.project.id=b76ad539b19f499fa6232d0ca420603c, user.id=77c8f12d58af443991170264b9f39a67) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:48.687326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc5e3c-46f2-4ed3-91c1-f522d2aea784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:48.688876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc5e3c-46f2-4ed3-91c1-f522d2aea784 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:48.696135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 166/318] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:29:48 2022] GET /identity/v3/role_assignments?user.id=77c8f12d58af443991170264b9f39a67&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=cdc99bb66fcc41f1a2b5ce626fa22557 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:48.796774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa450b-b940-4bf8-a43f-17f96f7f2532 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:48.797244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa450b-b940-4bf8-a43f-17f96f7f2532 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:48.797616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa450b-b940-4bf8-a43f-17f96f7f2532 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:48.799516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 153/319] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:48.805475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbd21-5900-43ce-ba0f-a842ecb14552 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:48.805817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbd21-5900-43ce-ba0f-a842ecb14552 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:48.806051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbd21-5900-43ce-ba0f-a842ecb14552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:48.826994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-040cbd21-5900-43ce-ba0f-a842ecb14552 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:48.828622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-040cbd21-5900-43ce-ba0f-a842ecb14552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:48.890359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9391e3-4181-4512-b993-65ce33c2ecd8 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:48.891074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9391e3-4181-4512-b993-65ce33c2ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:48.891368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9391e3-4181-4512-b993-65ce33c2ecd8 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:48.892997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 154/320] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:48.898416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ad55-95d4-4511-a3a0-82d3864ef7b6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:48.898707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ad55-95d4-4511-a3a0-82d3864ef7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:48.899074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ad55-95d4-4511-a3a0-82d3864ef7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:48.904896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 167/321] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:48.924412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b549ad55-95d4-4511-a3a0-82d3864ef7b6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:48.925886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b549ad55-95d4-4511-a3a0-82d3864ef7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:49.000484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 155/322] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:49.175130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cbd21-5900-43ce-ba0f-a842ecb14552 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:49.267756 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549ad55-95d4-4511-a3a0-82d3864ef7b6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:49.283191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:49.313714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cbd21-5900-43ce-ba0f-a842ecb14552 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:49.334710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:49.368487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f6b78-969c-406e-b91e-fd755d494f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:49.369376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f6b78-969c-406e-b91e-fd755d494f61 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:49.370413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f6b78-969c-406e-b91e-fd755d494f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:49.370754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f6b78-969c-406e-b91e-fd755d494f61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:49.388409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f6b78-969c-406e-b91e-fd755d494f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-151f6b78-969c-406e-b91e-fd755d494f61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:49.396666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:49.397620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:49.398900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 168/323] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:49.406880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f6b78-969c-406e-b91e-fd755d494f61 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:49.439277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549ad55-95d4-4511-a3a0-82d3864ef7b6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:49.481206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2673b-2e05-4425-88be-9a9c8f0c9ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:49.481858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2673b-2e05-4425-88be-9a9c8f0c9ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:49.482140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2673b-2e05-4425-88be-9a9c8f0c9ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:49.482430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2673b-2e05-4425-88be-9a9c8f0c9ad2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:49.483576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2673b-2e05-4425-88be-9a9c8f0c9ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:49.485042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2673b-2e05-4425-88be-9a9c8f0c9ad2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:49.486722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 156/324] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:29:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:49.493413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2673b-2e05-4425-88be-9a9c8f0c9ad2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:49.557919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f6b78-969c-406e-b91e-fd755d494f61 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:49.600456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:49.601090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:49.601371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:49.601635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:49.602324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:49.602671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:49.602946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:49.604238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:49.619848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 169/325] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:49.622680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:49.645196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2673b-2e05-4425-88be-9a9c8f0c9ad2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:49.680439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:49.702084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd9f05-0b8e-4127-a4c2-940fe2fb3fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:49.703371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9f05-0b8e-4127-a4c2-940fe2fb3fa6 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:49.703801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9f05-0b8e-4127-a4c2-940fe2fb3fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:49.704222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd9f05-0b8e-4127-a4c2-940fe2fb3fa6 None admin] PATH_INFO: `/v3/groups` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:49.705262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd9f05-0b8e-4127-a4c2-940fe2fb3fa6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:49.707467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd9f05-0b8e-4127-a4c2-940fe2fb3fa6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:49.730177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 157/326] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Aug 30 14:29:49 2022] POST /identity/v3/groups => generated 226 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:29:49.731991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfd14-145b-47cc-a221-14381b801065 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:49.732430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfd14-145b-47cc-a221-14381b801065 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:49.732786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfd14-145b-47cc-a221-14381b801065 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:49.734308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 158/327] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:49.740571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ea1f-a17d-4ec3-b09f-ce62f7a610cd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:49.741008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ea1f-a17d-4ec3-b09f-ce62f7a610cd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:49.741441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ea1f-a17d-4ec3-b09f-ce62f7a610cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:49.769913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3b04ea1f-a17d-4ec3-b09f-ce62f7a610cd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:49.771927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3b04ea1f-a17d-4ec3-b09f-ce62f7a610cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:49.809356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28766378-407b-48d8-9b93-9295b73798a3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:49.872604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc60e-998d-4fb6-b921-30cd6163df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:49.873376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc60e-998d-4fb6-b921-30cd6163df55 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:49.873823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc60e-998d-4fb6-b921-30cd6163df55 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:49.874270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc60e-998d-4fb6-b921-30cd6163df55 None admin] PATH_INFO: `/v3/users/d23268dcf19345bd90d6d9c5e0d7c9ed` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:49.876249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bc60e-998d-4fb6-b921-30cd6163df55 None admin] RBAC: Authorizing `identity:get_user(user_id=d23268dcf19345bd90d6d9c5e0d7c9ed)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:49.878836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bc60e-998d-4fb6-b921-30cd6163df55 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:49.888771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 170/328] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:49 2022] GET /identity/v3/users/d23268dcf19345bd90d6d9c5e0d7c9ed => generated 293 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:29:49.890100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc60e-998d-4fb6-b921-30cd6163df55 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:49.896074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 159/329] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:50.084521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc60e-998d-4fb6-b921-30cd6163df55 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:50.089768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:50.152142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe8d26-f551-4d6b-82bf-c59dfd53d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:50.153653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8d26-f551-4d6b-82bf-c59dfd53d089 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:50.154408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8d26-f551-4d6b-82bf-c59dfd53d089 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:50.155145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8d26-f551-4d6b-82bf-c59dfd53d089 None admin] PATH_INFO: `/v3/system/users/d23268dcf19345bd90d6d9c5e0d7c9ed/roles/cdc99bb66fcc41f1a2b5ce626fa22557` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:50.158099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe8d26-f551-4d6b-82bf-c59dfd53d089 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d23268dcf19345bd90d6d9c5e0d7c9ed, role_id=cdc99bb66fcc41f1a2b5ce626fa22557)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:50.161178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe8d26-f551-4d6b-82bf-c59dfd53d089 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:50.175891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 171/330] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Aug 30 14:29:49 2022] PUT /identity/v3/system/users/d23268dcf19345bd90d6d9c5e0d7c9ed/roles/cdc99bb66fcc41f1a2b5ce626fa22557 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:29:50.351475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ea1f-a17d-4ec3-b09f-ce62f7a610cd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:50.472418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:50.550872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ea1f-a17d-4ec3-b09f-ce62f7a610cd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:50.630427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa4df8-09d5-4a93-918a-8597c9cdd423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:50.631410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa4df8-09d5-4a93-918a-8597c9cdd423 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:50.631874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa4df8-09d5-4a93-918a-8597c9cdd423 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:50.632342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa4df8-09d5-4a93-918a-8597c9cdd423 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:50.656300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa4df8-09d5-4a93-918a-8597c9cdd423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-e2fa4df8-09d5-4a93-918a-8597c9cdd423 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:50.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:50.667534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:50.669067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 160/331] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:50.678712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe8d26-f551-4d6b-82bf-c59dfd53d089 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:50.904016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe8d26-f551-4d6b-82bf-c59dfd53d089 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:50.984050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:50.985082 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:50.985554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:50.986014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:50.987211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:50.987740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:50.990299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:51.016094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 172/332] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:51.025187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa4df8-09d5-4a93-918a-8597c9cdd423 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:51.249930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa4df8-09d5-4a93-918a-8597c9cdd423 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:51.303544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:51.326775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58183a2-fbc6-4240-8bf1-c5ea8e6cf972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:51.327829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58183a2-fbc6-4240-8bf1-c5ea8e6cf972 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:51.328656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58183a2-fbc6-4240-8bf1-c5ea8e6cf972 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:51.329115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58183a2-fbc6-4240-8bf1-c5ea8e6cf972 None admin] PATH_INFO: `/v3/users/e5449b4419254492a18770caac520c9d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:51.331289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58183a2-fbc6-4240-8bf1-c5ea8e6cf972 None admin] RBAC: Authorizing `identity:get_user(user_id=e5449b4419254492a18770caac520c9d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:51.333943 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58183a2-fbc6-4240-8bf1-c5ea8e6cf972 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:51.337411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 161/333] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:51 2022] GET /identity/v3/users/e5449b4419254492a18770caac520c9d => generated 293 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:51.346511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:51.424226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:51.571740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412bcf9-ad9e-4ec4-aa18-b72de0c91147 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:51.645227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e7b36-88a4-41da-9b9a-be4ff83f5f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:51.646240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7b36-88a4-41da-9b9a-be4ff83f5f7f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:51.646734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7b36-88a4-41da-9b9a-be4ff83f5f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:51.647195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e7b36-88a4-41da-9b9a-be4ff83f5f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:51.648492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e7b36-88a4-41da-9b9a-be4ff83f5f7f None admin] RBAC: Adding query filter params (role.id=2284ec91b47444249d339c70801cd407, user.id=e5449b4419254492a18770caac520c9d, scope.system=all) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:51.649021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e7b36-88a4-41da-9b9a-be4ff83f5f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:51.651854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e7b36-88a4-41da-9b9a-be4ff83f5f7f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:51.674459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 173/334] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Aug 30 14:29:51 2022] GET /identity/v3/role_assignments?user.id=e5449b4419254492a18770caac520c9d&scope.system=all&role.id=2284ec91b47444249d339c70801cd407 => generated 510 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:54.095477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a887-1bcd-4e66-867d-e60bff362852 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:54.097033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a887-1bcd-4e66-867d-e60bff362852 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:54.097738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a887-1bcd-4e66-867d-e60bff362852 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:54.100190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 162/335] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:54.107338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe73532-ad95-44ad-bd79-478835f4f668 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:54.108633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe73532-ad95-44ad-bd79-478835f4f668 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:54.109268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe73532-ad95-44ad-bd79-478835f4f668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:54.151239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4fe73532-ad95-44ad-bd79-478835f4f668 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:54.153880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4fe73532-ad95-44ad-bd79-478835f4f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:54.315866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 174/336] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:54.519852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55941-4bb9-4139-8555-8b6b9ef201a1 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:54.520834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55941-4bb9-4139-8555-8b6b9ef201a1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:54.521573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55941-4bb9-4139-8555-8b6b9ef201a1 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:54.524687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 163/337] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:54.533089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafd31f-12f1-4abb-991d-204ee0f3943d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:54.533931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafd31f-12f1-4abb-991d-204ee0f3943d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:54.534712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafd31f-12f1-4abb-991d-204ee0f3943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:54.573360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-eaafd31f-12f1-4abb-991d-204ee0f3943d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:54.575887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eaafd31f-12f1-4abb-991d-204ee0f3943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:54.612530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:54.723412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 175/338] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:54.835971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7a4fc-92cf-4667-a048-2faf8778a070 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:54.836508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7a4fc-92cf-4667-a048-2faf8778a070 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:54.836842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7a4fc-92cf-4667-a048-2faf8778a070 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:54.839555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 164/339] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:54.844440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafd31f-12f1-4abb-991d-204ee0f3943d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:54.849740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ba6c3-46c2-4703-9195-b5a1f9021232 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:54.850172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ba6c3-46c2-4703-9195-b5a1f9021232 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:54.850903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ba6c3-46c2-4703-9195-b5a1f9021232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:54.915038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e15ba6c3-46c2-4703-9195-b5a1f9021232 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:54.916912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e15ba6c3-46c2-4703-9195-b5a1f9021232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:55.182697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 165/340] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:55.185215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da679-49dd-4e35-9f5e-30232f4f5d84 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:55.185916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da679-49dd-4e35-9f5e-30232f4f5d84 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:55.186891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da679-49dd-4e35-9f5e-30232f4f5d84 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:55.193493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 166/341] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:55.200542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13d5c8-e06c-41f4-bc9a-e1838e6e9fbb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:55.201344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13d5c8-e06c-41f4-bc9a-e1838e6e9fbb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:55.201978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13d5c8-e06c-41f4-bc9a-e1838e6e9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:55.241371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-de13d5c8-e06c-41f4-bc9a-e1838e6e9fbb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:55.245618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafd31f-12f1-4abb-991d-204ee0f3943d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:55.247478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-de13d5c8-e06c-41f4-bc9a-e1838e6e9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:55.372036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adad17-bbdb-405e-bdff-ca967e3845de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:55.373623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adad17-bbdb-405e-bdff-ca967e3845de None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:55.374406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adad17-bbdb-405e-bdff-ca967e3845de None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:55.375148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adad17-bbdb-405e-bdff-ca967e3845de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:55.392852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 167/342] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:29:55.406050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adad17-bbdb-405e-bdff-ca967e3845de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-29adad17-bbdb-405e-bdff-ca967e3845de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:55.427278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:55.429325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:55.431240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:55.433954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 176/343] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 590 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:55.440171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13d5c8-e06c-41f4-bc9a-e1838e6e9fbb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:55.572756 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:55.668710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13d5c8-e06c-41f4-bc9a-e1838e6e9fbb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:55.728105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adad17-bbdb-405e-bdff-ca967e3845de None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:55.747839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:55.748755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:55.749185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:55.749598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:55.750469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:55.750942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:55.752358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:55.762614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:55.770611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 168/344] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:55.777974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:56.049896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adad17-bbdb-405e-bdff-ca967e3845de None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:56.090288 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8c155-84ae-4eca-b2db-dc3b32a92de4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:56.130836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:56.140177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff384f6-440b-4dcc-8a6c-ef42d1442f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:56.141739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff384f6-440b-4dcc-8a6c-ef42d1442f1d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:56.142592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff384f6-440b-4dcc-8a6c-ef42d1442f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:56.143406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff384f6-440b-4dcc-8a6c-ef42d1442f1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:56.171044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff384f6-440b-4dcc-8a6c-ef42d1442f1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:56.177070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e91ec-4e08-45f3-9864-5dc6950a2a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:56.178130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e91ec-4e08-45f3-9864-5dc6950a2a1e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:56.178657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e91ec-4e08-45f3-9864-5dc6950a2a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:56.179134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e91ec-4e08-45f3-9864-5dc6950a2a1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4ff384f6-440b-4dcc-8a6c-ef42d1442f1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:56.183353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:56.185050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:29:56.187215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:29:56.190825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 177/345] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:56.192570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff384f6-440b-4dcc-8a6c-ef42d1442f1d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:56.201235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e91ec-4e08-45f3-9864-5dc6950a2a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-fd4e91ec-4e08-45f3-9864-5dc6950a2a1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:56.214236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:56.216069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:56.217815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:56.222115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 169/346] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:29:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:29:56.223995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e91ec-4e08-45f3-9864-5dc6950a2a1e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:56.341414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:56.428719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff384f6-440b-4dcc-8a6c-ef42d1442f1d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:56.445135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e91ec-4e08-45f3-9864-5dc6950a2a1e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:56.484459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9714b90-19af-4782-8669-34ad5b8738e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:56.485424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714b90-19af-4782-8669-34ad5b8738e9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:56.485821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714b90-19af-4782-8669-34ad5b8738e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:56.486419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714b90-19af-4782-8669-34ad5b8738e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:56.517566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a3ee2-7d36-455c-8b5c-d32f96fa91ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:56.518225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a3ee2-7d36-455c-8b5c-d32f96fa91ec None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:56.518559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a3ee2-7d36-455c-8b5c-d32f96fa91ec None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:56.519591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a3ee2-7d36-455c-8b5c-d32f96fa91ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:56.546350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a3ee2-7d36-455c-8b5c-d32f96fa91ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-bf9a3ee2-7d36-455c-8b5c-d32f96fa91ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:56.556021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:56.557030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:56.559148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 170/347] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:56.560460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a3ee2-7d36-455c-8b5c-d32f96fa91ec None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:56.613926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9714b90-19af-4782-8669-34ad5b8738e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:56.616041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9714b90-19af-4782-8669-34ad5b8738e9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:56.625216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:56.732383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:56.739478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a3ee2-7d36-455c-8b5c-d32f96fa91ec None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:56.790368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 178/348] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:56.791560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586cd32-18d4-4b19-aef8-f8e4b00989cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:56.791905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9714b90-19af-4782-8669-34ad5b8738e9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:56.792500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586cd32-18d4-4b19-aef8-f8e4b00989cb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:56.792931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586cd32-18d4-4b19-aef8-f8e4b00989cb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:56.793378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586cd32-18d4-4b19-aef8-f8e4b00989cb None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:56.795656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586cd32-18d4-4b19-aef8-f8e4b00989cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:56.795656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586cd32-18d4-4b19-aef8-f8e4b00989cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:56.802196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586cd32-18d4-4b19-aef8-f8e4b00989cb None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:56.814676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 171/349] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:56.816490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1759ff-aaf5-482c-9671-e3a6c58bce05 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:56.816916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1759ff-aaf5-482c-9671-e3a6c58bce05 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:56.817316 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1759ff-aaf5-482c-9671-e3a6c58bce05 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:56.821038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 172/350] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:56.824551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d715a6-6c3a-466e-be00-e852274e2209 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:56.825426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d715a6-6c3a-466e-be00-e852274e2209 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:56.825873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d715a6-6c3a-466e-be00-e852274e2209 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:56.829581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 173/351] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:29:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:29:56.830723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d715a6-6c3a-466e-be00-e852274e2209 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:56.947441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9714b90-19af-4782-8669-34ad5b8738e9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:57.007716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:57.009092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:57.009523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:57.009970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:57.011220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:57.011667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:57.013219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:57.015075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:57.027013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 179/352] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:29:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:57.029196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:57.029581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d715a6-6c3a-466e-be00-e852274e2209 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:57.087370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:57.090527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:57.091412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:57.091844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:57.092252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:57.093035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:57.093386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:57.095736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:57.111838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 174/353] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:29:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:57.113102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:57.210660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1b22-30cc-40f3-b9cd-63ce013a2de7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:57.277732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7e9ed-96bd-450f-9806-3f2022da149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:57.279315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7e9ed-96bd-450f-9806-3f2022da149f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:57.279742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7e9ed-96bd-450f-9806-3f2022da149f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:57.280356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7e9ed-96bd-450f-9806-3f2022da149f None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:57.282298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7e9ed-96bd-450f-9806-3f2022da149f None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:57.283396 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28cf24-7ea1-4702-b6d1-2d7536966f5b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:57.284801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7e9ed-96bd-450f-9806-3f2022da149f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:57.287678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 180/354] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:57 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:57.289933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0751e48-7410-4b4a-b11c-23e801859c72 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:57.290419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0751e48-7410-4b4a-b11c-23e801859c72 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:57.290889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0751e48-7410-4b4a-b11c-23e801859c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:57.317345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c0751e48-7410-4b4a-b11c-23e801859c72 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:57.319289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c0751e48-7410-4b4a-b11c-23e801859c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:57.344692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0e80-ba37-4346-bd41-c3deb76e79fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:57.345653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0e80-ba37-4346-bd41-c3deb76e79fd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:57.346023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0e80-ba37-4346-bd41-c3deb76e79fd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:57.346444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0e80-ba37-4346-bd41-c3deb76e79fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:57.393741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:57.444092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 181/355] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:57.444092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16f59-a160-46c4-bde7-bb9d4830a651 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:57.444092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16f59-a160-46c4-bde7-bb9d4830a651 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:57.444092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16f59-a160-46c4-bde7-bb9d4830a651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:57.471313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0e80-ba37-4346-bd41-c3deb76e79fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:57.473408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0e80-ba37-4346-bd41-c3deb76e79fd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:57.480289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-66f16f59-a160-46c4-bde7-bb9d4830a651 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:29:57.482674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-66f16f59-a160-46c4-bde7-bb9d4830a651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:29:57.524179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:57.610109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 182/356] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:29:57.615478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f16f59-a160-46c4-bde7-bb9d4830a651 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:57.728094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 175/357] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:57.730097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0e80-ba37-4346-bd41-c3deb76e79fd None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:57.804467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f16f59-a160-46c4-bde7-bb9d4830a651 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:57.865305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:57.875271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdbef7-b7f2-4b43-8f22-abf69a120a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:57.876168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdbef7-b7f2-4b43-8f22-abf69a120a2d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:57.876601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdbef7-b7f2-4b43-8f22-abf69a120a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:57.877046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdbef7-b7f2-4b43-8f22-abf69a120a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:57.937840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:57.973424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0e80-ba37-4346-bd41-c3deb76e79fd None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:58.032548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdbef7-b7f2-4b43-8f22-abf69a120a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:58.035240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdbef7-b7f2-4b43-8f22-abf69a120a2d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:58.039156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57440ed-9382-49af-98a2-a54939e65d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:58.040962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57440ed-9382-49af-98a2-a54939e65d02 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:58.040962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57440ed-9382-49af-98a2-a54939e65d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:58.041341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57440ed-9382-49af-98a2-a54939e65d02 None admin] PATH_INFO: `/v3/users/d23268dcf19345bd90d6d9c5e0d7c9ed` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:58.043947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57440ed-9382-49af-98a2-a54939e65d02 None admin] RBAC: Authorizing `identity:get_user(user_id=d23268dcf19345bd90d6d9c5e0d7c9ed)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:58.046784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57440ed-9382-49af-98a2-a54939e65d02 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:58.050346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 176/358] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:29:57 2022] GET /identity/v3/users/d23268dcf19345bd90d6d9c5e0d7c9ed => generated 293 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:58.052025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57440ed-9382-49af-98a2-a54939e65d02 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.209659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 183/359] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:29:58.211263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdbef7-b7f2-4b43-8f22-abf69a120a2d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.240408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57440ed-9382-49af-98a2-a54939e65d02 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:58.280109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:58.294158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19547080-c511-4e7f-9aaa-ba79b7611c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:58.295046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547080-c511-4e7f-9aaa-ba79b7611c5e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:58.295476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547080-c511-4e7f-9aaa-ba79b7611c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:58.295906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547080-c511-4e7f-9aaa-ba79b7611c5e None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:58.297019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:58.305034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19547080-c511-4e7f-9aaa-ba79b7611c5e None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:58.306650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19547080-c511-4e7f-9aaa-ba79b7611c5e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:58.308602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 177/360] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:58.309850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19547080-c511-4e7f-9aaa-ba79b7611c5e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.367023 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdbef7-b7f2-4b43-8f22-abf69a120a2d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:58.412029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac60e3-f075-47a6-8778-97e28d8b263e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:58.413074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac60e3-f075-47a6-8778-97e28d8b263e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:58.413538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac60e3-f075-47a6-8778-97e28d8b263e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:58.413998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac60e3-f075-47a6-8778-97e28d8b263e None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:58.415602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac60e3-f075-47a6-8778-97e28d8b263e None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:58.417578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac60e3-f075-47a6-8778-97e28d8b263e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:58.419611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 184/361] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:58.420900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac60e3-f075-47a6-8778-97e28d8b263e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.444406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19547080-c511-4e7f-9aaa-ba79b7611c5e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:58.488751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc89b20-8c1e-4159-9b1b-a849cb813954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:58.489547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc89b20-8c1e-4159-9b1b-a849cb813954 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:58.489916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc89b20-8c1e-4159-9b1b-a849cb813954 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:58.490267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc89b20-8c1e-4159-9b1b-a849cb813954 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:58.506627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc89b20-8c1e-4159-9b1b-a849cb813954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7fc89b20-8c1e-4159-9b1b-a849cb813954 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:58.513345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:58.515117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 178/362] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:58.516680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc89b20-8c1e-4159-9b1b-a849cb813954 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.553344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac60e3-f075-47a6-8778-97e28d8b263e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:58.575629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:58.589433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:58.600232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:58.600983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:58.601434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:58.601847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:58.602819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] RBAC: Adding query filter params (role.id=cdc99bb66fcc41f1a2b5ce626fa22557, user.id=d23268dcf19345bd90d6d9c5e0d7c9ed, scope.system=all) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:58.603338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:58.605774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:58.622157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 185/363] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/role_assignments?user.id=d23268dcf19345bd90d6d9c5e0d7c9ed&scope.system=all&role.id=cdc99bb66fcc41f1a2b5ce626fa22557 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:58.623568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.647562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc89b20-8c1e-4159-9b1b-a849cb813954 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:58.695516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f474b-15f0-4f86-9e35-6c0d0f6dd7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:58.696428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f474b-15f0-4f86-9e35-6c0d0f6dd7ab None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:58.696860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f474b-15f0-4f86-9e35-6c0d0f6dd7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:58.697275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f474b-15f0-4f86-9e35-6c0d0f6dd7ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:58.712940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f474b-15f0-4f86-9e35-6c0d0f6dd7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-cc3f474b-15f0-4f86-9e35-6c0d0f6dd7ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:29:58.719416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:29:58.720969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 179/364] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:29:58.722369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f474b-15f0-4f86-9e35-6c0d0f6dd7ab None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.816660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165c58d-8998-496b-a402-efa904147b75 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:58.865189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f474b-15f0-4f86-9e35-6c0d0f6dd7ab None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:58.882321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:58.885472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237dcdf-ba3f-487d-b08b-3b3d367d9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:58.887891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237dcdf-ba3f-487d-b08b-3b3d367d9bff None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:58.888689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237dcdf-ba3f-487d-b08b-3b3d367d9bff None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:58.889112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237dcdf-ba3f-487d-b08b-3b3d367d9bff None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:58.890944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237dcdf-ba3f-487d-b08b-3b3d367d9bff None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:58.893470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237dcdf-ba3f-487d-b08b-3b3d367d9bff None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:58.896306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 186/365] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:58.899288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237dcdf-ba3f-487d-b08b-3b3d367d9bff None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.935633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:58.936433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:58.937054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:58.937481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:58.940214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] RBAC: Adding query filter params (group.id=27007395fc674e14b7fff07aba7c2d0e, role.id=2284ec91b47444249d339c70801cd407, scope.project.id=1eda274b900241bf883d02a37e874f06) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:58.940214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:58.941370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:58.949931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 180/366] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/role_assignments?group.id=27007395fc674e14b7fff07aba7c2d0e&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=2284ec91b47444249d339c70801cd407 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:58.951357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:58.993389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:59.104207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237dcdf-ba3f-487d-b08b-3b3d367d9bff None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:59.156256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2e85-1cf2-478f-aa3f-8152479fbdea None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:59.175093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cafe-bdaa-4002-811d-a7fb1d17ab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:59.176409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cafe-bdaa-4002-811d-a7fb1d17ab88 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:59.177029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cafe-bdaa-4002-811d-a7fb1d17ab88 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:59.177668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6cafe-bdaa-4002-811d-a7fb1d17ab88 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:59.182736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6cafe-bdaa-4002-811d-a7fb1d17ab88 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:59.184355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6cafe-bdaa-4002-811d-a7fb1d17ab88 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:59.187254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 187/367] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:59.191200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cafe-bdaa-4002-811d-a7fb1d17ab88 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:59.246340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:59.247749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:59.248989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:59.249488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:59.251037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:59.251693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:59.254561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:59.277065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 181/368] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:29:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:59.279669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:59.352968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:59.372782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6cafe-bdaa-4002-811d-a7fb1d17ab88 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:59.400275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:59.432670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:59.433714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:59.434165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:59.434638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:59.436552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:59.437088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:59.440170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:59.458092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 188/369] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:59.459344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:59.474700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b00f2-5dae-40f4-b1c4-31a46351b326 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:59.536407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b397d-c558-4599-8543-7cf047d6c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:59.537401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b397d-c558-4599-8543-7cf047d6c84e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:59.537861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b397d-c558-4599-8543-7cf047d6c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:59.538319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b397d-c558-4599-8543-7cf047d6c84e None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:59.539904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b397d-c558-4599-8543-7cf047d6c84e None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:59.543385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b397d-c558-4599-8543-7cf047d6c84e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:59.545817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 182/370] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:29:59 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:59.548542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b397d-c558-4599-8543-7cf047d6c84e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:59.644650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6277cb-a480-4f47-9e36-3c2ac042d74b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:59.689039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:59.689819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:59.690233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:59.690681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:59.691545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] RBAC: Adding query filter params (group.id=27007395fc674e14b7fff07aba7c2d0e, role.id=2284ec91b47444249d339c70801cd407, scope.project.id=b76ad539b19f499fa6232d0ca420603c) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:29:59.692681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:59.693990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:29:59.710643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 189/371] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:29:59 2022] GET /identity/v3/role_assignments?group.id=27007395fc674e14b7fff07aba7c2d0e&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=2284ec91b47444249d339c70801cd407 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:29:59.710643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:29:59.752195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b397d-c558-4599-8543-7cf047d6c84e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:59.761995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:59.819775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:29:59.834794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271506b-5c23-4028-ae79-11da2c15f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:29:59.835743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271506b-5c23-4028-ae79-11da2c15f808 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:29:59.837154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271506b-5c23-4028-ae79-11da2c15f808 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:29:59.837601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271506b-5c23-4028-ae79-11da2c15f808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:29:59.940576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7922637-f188-4aa2-9732-afb6a3bb9508 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:29:59.979361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271506b-5c23-4028-ae79-11da2c15f808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:29:59.981890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271506b-5c23-4028-ae79-11da2c15f808 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:00.014885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359c48-82d8-4d9b-ac53-e87a5a705014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:00.016932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359c48-82d8-4d9b-ac53-e87a5a705014 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:00.017604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359c48-82d8-4d9b-ac53-e87a5a705014 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:00.018298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359c48-82d8-4d9b-ac53-e87a5a705014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:00.116341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38359c48-82d8-4d9b-ac53-e87a5a705014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:00.118801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38359c48-82d8-4d9b-ac53-e87a5a705014 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:00.187066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:00.194597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 183/372] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:00.194597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271506b-5c23-4028-ae79-11da2c15f808 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:00.199673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:00.276396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 190/373] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:00.277858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359c48-82d8-4d9b-ac53-e87a5a705014 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:00.355008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271506b-5c23-4028-ae79-11da2c15f808 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:00.434169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:00.435306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:00.435801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:00.436265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:00.437607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] RBAC: Adding query filter params (group.id=27007395fc674e14b7fff07aba7c2d0e, role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=1eda274b900241bf883d02a37e874f06) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:00.438165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:00.440970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:00.458701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 184/374] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:30:00 2022] GET /identity/v3/role_assignments?group.id=27007395fc674e14b7fff07aba7c2d0e&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:00.460219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:00.534291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359c48-82d8-4d9b-ac53-e87a5a705014 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:00.661900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5908b60-9347-4f9f-967c-38e5abd22727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:00.663094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908b60-9347-4f9f-967c-38e5abd22727 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:00.663589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908b60-9347-4f9f-967c-38e5abd22727 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:00.664052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5908b60-9347-4f9f-967c-38e5abd22727 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:00.668619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5908b60-9347-4f9f-967c-38e5abd22727 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:00.671170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5908b60-9347-4f9f-967c-38e5abd22727 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:00.674445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 191/375] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:00 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:00.681046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5908b60-9347-4f9f-967c-38e5abd22727 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:00.708237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:00.718138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:00.753454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687331-727f-41a8-b233-6bc376976528 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:00.790557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c62c-f688-42c8-8582-d0628f63311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:00.791651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c62c-f688-42c8-8582-d0628f63311b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:00.792126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c62c-f688-42c8-8582-d0628f63311b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:00.792577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c62c-f688-42c8-8582-d0628f63311b None admin] PATH_INFO: `/v3/projects/259468708afd445bab53811821f0bda0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:00.793952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7c62c-f688-42c8-8582-d0628f63311b None admin] RBAC: Authorizing `identity:get_project(project_id=259468708afd445bab53811821f0bda0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:00.795724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7c62c-f688-42c8-8582-d0628f63311b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:00.797972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 185/376] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:00 2022] GET /identity/v3/projects/259468708afd445bab53811821f0bda0 => generated 344 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:00.804186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c62c-f688-42c8-8582-d0628f63311b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:00.933525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c62c-f688-42c8-8582-d0628f63311b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:00.941634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5908b60-9347-4f9f-967c-38e5abd22727 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:00.974347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddee816-5d9a-4528-8948-ea88d86a0515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:00.975481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddee816-5d9a-4528-8948-ea88d86a0515 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:00.975983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddee816-5d9a-4528-8948-ea88d86a0515 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:00.976499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddee816-5d9a-4528-8948-ea88d86a0515 None admin] PATH_INFO: `/v3/groups/fd9ba3949b164a018e9e69ed6d28b0aa` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:00.980249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:00.983755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddee816-5d9a-4528-8948-ea88d86a0515 None admin] RBAC: Authorizing `identity:get_group(group_id=fd9ba3949b164a018e9e69ed6d28b0aa)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:00.985769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddee816-5d9a-4528-8948-ea88d86a0515 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:00.989152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 186/377] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:00 2022] GET /identity/v3/groups/fd9ba3949b164a018e9e69ed6d28b0aa => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:00.995398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddee816-5d9a-4528-8948-ea88d86a0515 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:01.032951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff092d1a-60c1-469c-a67f-9564d3929dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:01.035651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092d1a-60c1-469c-a67f-9564d3929dfc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:01.036219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092d1a-60c1-469c-a67f-9564d3929dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:01.038025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092d1a-60c1-469c-a67f-9564d3929dfc None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:01.041299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff092d1a-60c1-469c-a67f-9564d3929dfc None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:01.045189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff092d1a-60c1-469c-a67f-9564d3929dfc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:01.049955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 192/378] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:00 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:01.056495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff092d1a-60c1-469c-a67f-9564d3929dfc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:01.195044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:01.218570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff092d1a-60c1-469c-a67f-9564d3929dfc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:01.232789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddee816-5d9a-4528-8948-ea88d86a0515 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:01.272462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a8a52-7921-4f48-938d-37c489f3b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:01.273196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a8a52-7921-4f48-938d-37c489f3b602 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:01.273518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a8a52-7921-4f48-938d-37c489f3b602 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:01.273929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a8a52-7921-4f48-938d-37c489f3b602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:01.274685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a8a52-7921-4f48-938d-37c489f3b602 None admin] RBAC: Adding query filter params (group.id=fd9ba3949b164a018e9e69ed6d28b0aa, role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=259468708afd445bab53811821f0bda0) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:01.275050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a8a52-7921-4f48-938d-37c489f3b602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:01.276656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a8a52-7921-4f48-938d-37c489f3b602 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:01.284114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 187/379] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:30:00 2022] GET /identity/v3/role_assignments?group.id=fd9ba3949b164a018e9e69ed6d28b0aa&scope.project.id=259468708afd445bab53811821f0bda0&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:01.285812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e32a-d757-4790-9aee-e7b74d418a6c None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:01.286156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e32a-d757-4790-9aee-e7b74d418a6c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:01.286510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e32a-d757-4790-9aee-e7b74d418a6c None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:01.292965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 188/380] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:01.294865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1f67-792e-4d58-afe9-4f5f336e6ec6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:01.295074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1f67-792e-4d58-afe9-4f5f336e6ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:01.295306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b1f67-792e-4d58-afe9-4f5f336e6ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:01.306293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:01.307864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:01.308630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:01.309419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:01.311195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] RBAC: Adding query filter params (group.id=27007395fc674e14b7fff07aba7c2d0e, role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=b76ad539b19f499fa6232d0ca420603c) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:01.311500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:01.312981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:01.319141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ff7b1f67-792e-4d58-afe9-4f5f336e6ec6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:01.320420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ff7b1f67-792e-4d58-afe9-4f5f336e6ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:01.330274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 193/381] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:30:01 2022] GET /identity/v3/role_assignments?group.id=27007395fc674e14b7fff07aba7c2d0e&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:01.441956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:01.454783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 189/382] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:01.736400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:01.889942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8e1e-e88b-40ef-80fa-75a4de589c51 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:01.955311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038da9e-5ef3-4355-927a-07f36cb297ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:01.956383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038da9e-5ef3-4355-927a-07f36cb297ba None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:01.956865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038da9e-5ef3-4355-927a-07f36cb297ba None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:01.957415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038da9e-5ef3-4355-927a-07f36cb297ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:01.976212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038da9e-5ef3-4355-927a-07f36cb297ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4038da9e-5ef3-4355-927a-07f36cb297ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:01.987440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:01.988362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:30:01.989134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:01.989715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 194/383] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:01.999013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b1f67-792e-4d58-afe9-4f5f336e6ec6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:02.179536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b1f67-792e-4d58-afe9-4f5f336e6ec6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:02.237712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:02.238247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:02.238626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:02.239013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:02.239941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:02.240241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:02.241968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:02.252253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 190/384] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:30:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:02.260495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038da9e-5ef3-4355-927a-07f36cb297ba None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:02.276461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:02.438641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038da9e-5ef3-4355-927a-07f36cb297ba None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:02.477850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ec0e9-7409-4109-bbce-0147f3df0726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:02.478536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ec0e9-7409-4109-bbce-0147f3df0726 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:02.478876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ec0e9-7409-4109-bbce-0147f3df0726 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:02.479151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ec0e9-7409-4109-bbce-0147f3df0726 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:02.480345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ec0e9-7409-4109-bbce-0147f3df0726 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:02.481876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ec0e9-7409-4109-bbce-0147f3df0726 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:02.483940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 195/385] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:02 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:02.491647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:02.564561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:02.612123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105e298-ab66-4233-8866-b3124b9bc507 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:02.612463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105e298-ab66-4233-8866-b3124b9bc507 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:02.612671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105e298-ab66-4233-8866-b3124b9bc507 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:02.614236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 196/386] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:02.620042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60f1f7-4c5a-4c48-b8f8-519a3b627997 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:02.620663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60f1f7-4c5a-4c48-b8f8-519a3b627997 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:02.621132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60f1f7-4c5a-4c48-b8f8-519a3b627997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:02.622199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1f441-f1e3-4102-a659-1b6300964156 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:02.645292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8c60f1f7-4c5a-4c48-b8f8-519a3b627997 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:02.647508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8c60f1f7-4c5a-4c48-b8f8-519a3b627997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:02.705557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1af78a-20f5-4b7b-a836-08e054ecaf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:02.706231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1af78a-20f5-4b7b-a836-08e054ecaf0a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:02.706532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1af78a-20f5-4b7b-a836-08e054ecaf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:02.706807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1af78a-20f5-4b7b-a836-08e054ecaf0a None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:02.708016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1af78a-20f5-4b7b-a836-08e054ecaf0a None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:02.709497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1af78a-20f5-4b7b-a836-08e054ecaf0a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:02.711247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 191/387] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:02 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:02.727456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1af78a-20f5-4b7b-a836-08e054ecaf0a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:02.748746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 197/388] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:02.907986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1af78a-20f5-4b7b-a836-08e054ecaf0a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:02.956895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:02.984828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec3f0e-5891-4657-abed-ba381ecb9e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:02.985940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec3f0e-5891-4657-abed-ba381ecb9e82 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:02.986435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec3f0e-5891-4657-abed-ba381ecb9e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:02.986927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec3f0e-5891-4657-abed-ba381ecb9e82 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06/groups/27007395fc674e14b7fff07aba7c2d0e/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:02.990595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec3f0e-5891-4657-abed-ba381ecb9e82 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eda274b900241bf883d02a37e874f06, group_id=27007395fc674e14b7fff07aba7c2d0e, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:02.993413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec3f0e-5891-4657-abed-ba381ecb9e82 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:03.025392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 192/389] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Aug 30 14:30:02 2022] PUT /identity/v3/projects/1eda274b900241bf883d02a37e874f06/groups/27007395fc674e14b7fff07aba7c2d0e/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:03.197116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60f1f7-4c5a-4c48-b8f8-519a3b627997 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:03.205077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:03.400320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60f1f7-4c5a-4c48-b8f8-519a3b627997 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:03.467890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7cbae-7f50-4f8c-a1b4-c4946df507d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:03.468969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7cbae-7f50-4f8c-a1b4-c4946df507d3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:03.469440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7cbae-7f50-4f8c-a1b4-c4946df507d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:03.469900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7cbae-7f50-4f8c-a1b4-c4946df507d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:03.490961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7cbae-7f50-4f8c-a1b4-c4946df507d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0bb7cbae-7f50-4f8c-a1b4-c4946df507d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:03.502815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:03.504556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:03.506112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 198/390] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:03.524182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec3f0e-5891-4657-abed-ba381ecb9e82 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:03.648425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d95bb-ca97-4957-b190-290f0c7137c4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:03.648862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d95bb-ca97-4957-b190-290f0c7137c4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:03.649282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d95bb-ca97-4957-b190-290f0c7137c4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:03.660148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 199/391] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:03.670563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e57f0-d29d-4869-9368-17b5555d68d1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:03.670986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e57f0-d29d-4869-9368-17b5555d68d1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:03.671407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e57f0-d29d-4869-9368-17b5555d68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:03.731777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e32e57f0-d29d-4869-9368-17b5555d68d1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:03.733847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e32e57f0-d29d-4869-9368-17b5555d68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:03.784360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec3f0e-5891-4657-abed-ba381ecb9e82 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:03.849091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:03.850107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:03.850611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:03.851086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:03.852327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:03.852870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:03.855448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:03.872605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 193/392] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:30:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:03.881841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:03.977311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:04.005474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 200/393] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:04.055065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:04.189332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf013-f9e3-43ed-86e8-0b2db2288d7b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:04.245318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c6fa4-bc15-43bf-bcc1-6513770b2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:04.245868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6fa4-bc15-43bf-bcc1-6513770b2329 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:04.246138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6fa4-bc15-43bf-bcc1-6513770b2329 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:04.246426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6fa4-bc15-43bf-bcc1-6513770b2329 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:04.247654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c6fa4-bc15-43bf-bcc1-6513770b2329 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:04.249103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c6fa4-bc15-43bf-bcc1-6513770b2329 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:04.250748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 194/394] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:03 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:04.259886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e57f0-d29d-4869-9368-17b5555d68d1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:04.445895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff19d-c400-44b8-85f1-1751066513ad None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:04.446854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff19d-c400-44b8-85f1-1751066513ad None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:04.448057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff19d-c400-44b8-85f1-1751066513ad None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:04.451520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 195/395] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:04.461980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9334d-9ed3-4321-b230-9c714dcd9dc7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:04.462859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9334d-9ed3-4321-b230-9c714dcd9dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:04.463824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9334d-9ed3-4321-b230-9c714dcd9dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:04.520340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-bac9334d-9ed3-4321-b230-9c714dcd9dc7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:04.522808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bac9334d-9ed3-4321-b230-9c714dcd9dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:04.523923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e57f0-d29d-4869-9368-17b5555d68d1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:04.601300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551abe1-31c5-4bd7-bf58-bd0db0f080e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:04.603829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551abe1-31c5-4bd7-bf58-bd0db0f080e8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:04.604646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551abe1-31c5-4bd7-bf58-bd0db0f080e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:04.605307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551abe1-31c5-4bd7-bf58-bd0db0f080e8 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:04.608014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551abe1-31c5-4bd7-bf58-bd0db0f080e8 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:04.611953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551abe1-31c5-4bd7-bf58-bd0db0f080e8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:04.615800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 201/396] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:04 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:04.617880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551abe1-31c5-4bd7-bf58-bd0db0f080e8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:04.694278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 196/397] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:04.697042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9334d-9ed3-4321-b230-9c714dcd9dc7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:04.765284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:04.802700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:04.862555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551abe1-31c5-4bd7-bf58-bd0db0f080e8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:04.933060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9334d-9ed3-4321-b230-9c714dcd9dc7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:04.943949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72114b4f-24f0-422f-9c1d-8ff4a59132d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:04.945557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114b4f-24f0-422f-9c1d-8ff4a59132d2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:04.946420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114b4f-24f0-422f-9c1d-8ff4a59132d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:04.947189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72114b4f-24f0-422f-9c1d-8ff4a59132d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:04.969372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72114b4f-24f0-422f-9c1d-8ff4a59132d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-72114b4f-24f0-422f-9c1d-8ff4a59132d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:04.981113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:04.983590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:04.985196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:04.996329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 202/398] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:30:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:04.999483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574e16f-c066-4080-899c-9253b92a6c0d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:05.000299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574e16f-c066-4080-899c-9253b92a6c0d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:05.001243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574e16f-c066-4080-899c-9253b92a6c0d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:05.005245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 203/399] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:05.006285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea0c9d-ee7e-452d-a473-ff36a5a1bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:05.007486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea0c9d-ee7e-452d-a473-ff36a5a1bba2 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:05.007973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea0c9d-ee7e-452d-a473-ff36a5a1bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:05.008519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea0c9d-ee7e-452d-a473-ff36a5a1bba2 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c/groups/27007395fc674e14b7fff07aba7c2d0e/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:05.009063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574e16f-c066-4080-899c-9253b92a6c0d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:05.012410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea0c9d-ee7e-452d-a473-ff36a5a1bba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b76ad539b19f499fa6232d0ca420603c, group_id=27007395fc674e14b7fff07aba7c2d0e, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:05.015162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea0c9d-ee7e-452d-a473-ff36a5a1bba2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:05.038560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 197/400] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Aug 30 14:30:04 2022] PUT /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c/groups/27007395fc674e14b7fff07aba7c2d0e/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:05.041417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68ebc-4457-434e-be6e-9f1563b29830 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:05.042425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68ebc-4457-434e-be6e-9f1563b29830 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:05.042425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68ebc-4457-434e-be6e-9f1563b29830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:05.079603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2ab68ebc-4457-434e-be6e-9f1563b29830 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:05.081433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2ab68ebc-4457-434e-be6e-9f1563b29830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:05.227159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 198/401] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:05.227738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574e16f-c066-4080-899c-9253b92a6c0d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:05.231133 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab68ebc-4457-434e-be6e-9f1563b29830 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:05.268017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:05.296870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:05.297927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:05.298430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:05.298899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:05.299938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:05.302571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:05.303240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:05.306633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:05.322178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 204/402] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:05.333808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:05.445425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab68ebc-4457-434e-be6e-9f1563b29830 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:05.526514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79d373-5ac5-45bb-89c3-d970e13effc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:05.527626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d373-5ac5-45bb-89c3-d970e13effc5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:05.528111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d373-5ac5-45bb-89c3-d970e13effc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:05.528592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d373-5ac5-45bb-89c3-d970e13effc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:05.568108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79d373-5ac5-45bb-89c3-d970e13effc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-3a79d373-5ac5-45bb-89c3-d970e13effc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:05.582717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:05.583711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:05.584656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:05.593411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 199/403] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:30:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:05.603292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79d373-5ac5-45bb-89c3-d970e13effc5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:05.667874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b91ec-b180-4720-bcbf-79ea16eb1058 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:05.740832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508297-bb73-4fbf-a0fd-73b03b863282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:05.742032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508297-bb73-4fbf-a0fd-73b03b863282 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:05.742540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508297-bb73-4fbf-a0fd-73b03b863282 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:05.743024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59508297-bb73-4fbf-a0fd-73b03b863282 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:05.745201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59508297-bb73-4fbf-a0fd-73b03b863282 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:05.748286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59508297-bb73-4fbf-a0fd-73b03b863282 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:05.749036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:05.752527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 205/404] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:05 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:05.753956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508297-bb73-4fbf-a0fd-73b03b863282 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:05.756944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79d373-5ac5-45bb-89c3-d970e13effc5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:05.797662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:05.798298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:05.798610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:05.798877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:05.799553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:05.799855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:05.801263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:05.811776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 200/405] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:05.812684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:05.880499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:05.965873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1ad40-e3aa-4a7b-9c60-13aa84cfab6a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:05.971993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59508297-bb73-4fbf-a0fd-73b03b863282 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:06.013271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a954-0089-4b7c-a325-7b6dcd0edf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.014810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a954-0089-4b7c-a325-7b6dcd0edf8e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.015286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a954-0089-4b7c-a325-7b6dcd0edf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.015832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a954-0089-4b7c-a325-7b6dcd0edf8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.028830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9a954-0089-4b7c-a325-7b6dcd0edf8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-22e9a954-0089-4b7c-a325-7b6dcd0edf8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:06.034889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:06.035896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:30:06.036684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:06.039374 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 206/406] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:30:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:06.040502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a954-0089-4b7c-a325-7b6dcd0edf8e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:06.049838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd11bc-ee65-4b0d-b5e7-eecd3d953d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.050539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd11bc-ee65-4b0d-b5e7-eecd3d953d8d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.050820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd11bc-ee65-4b0d-b5e7-eecd3d953d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.051089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd11bc-ee65-4b0d-b5e7-eecd3d953d8d None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.052251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd11bc-ee65-4b0d-b5e7-eecd3d953d8d None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:06.053724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd11bc-ee65-4b0d-b5e7-eecd3d953d8d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:06.060364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 201/407] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:05 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:06.060364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd11bc-ee65-4b0d-b5e7-eecd3d953d8d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:06.092431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:06.175243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd11bc-ee65-4b0d-b5e7-eecd3d953d8d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:06.195263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a954-0089-4b7c-a325-7b6dcd0edf8e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:06.211503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:06.221779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.222576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.222857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.223130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.224454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:06.224764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:06.226549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:06.239529 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 202/408] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:06.240602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d967d-eff0-46e8-a8f5-b304d8664cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.241534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d967d-eff0-46e8-a8f5-b304d8664cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.242051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d967d-eff0-46e8-a8f5-b304d8664cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.242552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d967d-eff0-46e8-a8f5-b304d8664cc6 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.243958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d967d-eff0-46e8-a8f5-b304d8664cc6 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:06.245402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:06.246498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d967d-eff0-46e8-a8f5-b304d8664cc6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:06.248856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 207/409] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:06 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:06.249911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d967d-eff0-46e8-a8f5-b304d8664cc6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:06.373490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:06.375512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d967d-eff0-46e8-a8f5-b304d8664cc6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:06.392715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b9d07-e16d-4774-9353-1d4de45d9b5f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:06.421802 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e416f-3507-4d22-bb9a-f97a40c76928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.422558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e416f-3507-4d22-bb9a-f97a40c76928 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.422890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e416f-3507-4d22-bb9a-f97a40c76928 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.423105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e416f-3507-4d22-bb9a-f97a40c76928 None admin] PATH_INFO: `/v3/groups/fd9ba3949b164a018e9e69ed6d28b0aa` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.424550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e416f-3507-4d22-bb9a-f97a40c76928 None admin] RBAC: Authorizing `identity:get_group(group_id=fd9ba3949b164a018e9e69ed6d28b0aa)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:06.426190 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e416f-3507-4d22-bb9a-f97a40c76928 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:06.427877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 208/410] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:06 2022] GET /identity/v3/groups/fd9ba3949b164a018e9e69ed6d28b0aa => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:06.433510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e416f-3507-4d22-bb9a-f97a40c76928 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:06.435769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cb4e4-f89b-45ca-937f-c438300cbcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.436462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb4e4-f89b-45ca-937f-c438300cbcf9 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.436734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb4e4-f89b-45ca-937f-c438300cbcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.437002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb4e4-f89b-45ca-937f-c438300cbcf9 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06/groups/27007395fc674e14b7fff07aba7c2d0e/roles/0ac8e76ee0884ae1be64093499d4865e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.440165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cb4e4-f89b-45ca-937f-c438300cbcf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eda274b900241bf883d02a37e874f06, group_id=27007395fc674e14b7fff07aba7c2d0e, role_id=0ac8e76ee0884ae1be64093499d4865e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:06.441625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cb4e4-f89b-45ca-937f-c438300cbcf9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:06.457193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 203/411] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Aug 30 14:30:06 2022] PUT /identity/v3/projects/1eda274b900241bf883d02a37e874f06/groups/27007395fc674e14b7fff07aba7c2d0e/roles/0ac8e76ee0884ae1be64093499d4865e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:06.458542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf6b2d-fba9-4872-9bf7-e90091fd2317 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.458828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf6b2d-fba9-4872-9bf7-e90091fd2317 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.459098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf6b2d-fba9-4872-9bf7-e90091fd2317 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.465061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 204/412] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:06.466066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf6b2d-fba9-4872-9bf7-e90091fd2317 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:06.523093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:06.618075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e416f-3507-4d22-bb9a-f97a40c76928 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:06.629076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf6b2d-fba9-4872-9bf7-e90091fd2317 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:06.687990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adeb66-c84b-4d1c-b43c-a679deca6760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.689401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adeb66-c84b-4d1c-b43c-a679deca6760 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.689882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adeb66-c84b-4d1c-b43c-a679deca6760 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.690338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adeb66-c84b-4d1c-b43c-a679deca6760 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.691442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0338-ceb3-49bd-9c44-5ada6313a023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.691752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adeb66-c84b-4d1c-b43c-a679deca6760 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:06.692580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0338-ceb3-49bd-9c44-5ada6313a023 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.693087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0338-ceb3-49bd-9c44-5ada6313a023 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.693553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0338-ceb3-49bd-9c44-5ada6313a023 None admin] PATH_INFO: `/v3/projects/259468708afd445bab53811821f0bda0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.693929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adeb66-c84b-4d1c-b43c-a679deca6760 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:06.695679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0338-ceb3-49bd-9c44-5ada6313a023 None admin] RBAC: Authorizing `identity:get_project(project_id=259468708afd445bab53811821f0bda0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:06.697473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 209/413] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:06 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:06.699187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0338-ceb3-49bd-9c44-5ada6313a023 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:06.699390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42210d-c21b-459c-8766-e30626ae341b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.699840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42210d-c21b-459c-8766-e30626ae341b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.700299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42210d-c21b-459c-8766-e30626ae341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.706202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 205/414] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:06 2022] GET /identity/v3/projects/259468708afd445bab53811821f0bda0 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:06.706202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0338-ceb3-49bd-9c44-5ada6313a023 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:06.729975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-af42210d-c21b-459c-8766-e30626ae341b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:06.730663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:06.733135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-af42210d-c21b-459c-8766-e30626ae341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:06.852516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0338-ceb3-49bd-9c44-5ada6313a023 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:06.890414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 210/415] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:06.891304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42210d-c21b-459c-8766-e30626ae341b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:06.921791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750836-5eb3-473c-aeb6-1dcf9a7d00f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:06.924105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750836-5eb3-473c-aeb6-1dcf9a7d00f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:06.925189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750836-5eb3-473c-aeb6-1dcf9a7d00f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:06.925862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750836-5eb3-473c-aeb6-1dcf9a7d00f0 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c/groups/27007395fc674e14b7fff07aba7c2d0e/roles/0ac8e76ee0884ae1be64093499d4865e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:06.931127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750836-5eb3-473c-aeb6-1dcf9a7d00f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b76ad539b19f499fa6232d0ca420603c, group_id=27007395fc674e14b7fff07aba7c2d0e, role_id=0ac8e76ee0884ae1be64093499d4865e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:06.935145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750836-5eb3-473c-aeb6-1dcf9a7d00f0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:06.959470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:06.982567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 206/416] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Aug 30 14:30:06 2022] PUT /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c/groups/27007395fc674e14b7fff07aba7c2d0e/roles/0ac8e76ee0884ae1be64093499d4865e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:07.033545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42210d-c21b-459c-8766-e30626ae341b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:07.079119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28d122-7e14-425e-9ec2-edfa4cedf623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:07.080102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d122-7e14-425e-9ec2-edfa4cedf623 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:07.080519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d122-7e14-425e-9ec2-edfa4cedf623 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:07.080925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d122-7e14-425e-9ec2-edfa4cedf623 None admin] PATH_INFO: `/v3/projects/259468708afd445bab53811821f0bda0/groups/fd9ba3949b164a018e9e69ed6d28b0aa/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:07.083296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28d122-7e14-425e-9ec2-edfa4cedf623 None admin] RBAC: Authorizing `identity:create_grant(project_id=259468708afd445bab53811821f0bda0, group_id=fd9ba3949b164a018e9e69ed6d28b0aa, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:07.085052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28d122-7e14-425e-9ec2-edfa4cedf623 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:07.111954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 211/417] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Aug 30 14:30:06 2022] PUT /identity/v3/projects/259468708afd445bab53811821f0bda0/groups/fd9ba3949b164a018e9e69ed6d28b0aa/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:07.373533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750836-5eb3-473c-aeb6-1dcf9a7d00f0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:07.487632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:07.519884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750836-5eb3-473c-aeb6-1dcf9a7d00f0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:07.572283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398940b-bf27-4cba-ac91-87bf42b38b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:07.573428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398940b-bf27-4cba-ac91-87bf42b38b98 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:07.573936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398940b-bf27-4cba-ac91-87bf42b38b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:07.574580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398940b-bf27-4cba-ac91-87bf42b38b98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:07.595327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398940b-bf27-4cba-ac91-87bf42b38b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-9398940b-bf27-4cba-ac91-87bf42b38b98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:07.601251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:07.602213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:30:07.603059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:07.606270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 207/418] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:07.612697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28d122-7e14-425e-9ec2-edfa4cedf623 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:07.840083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28d122-7e14-425e-9ec2-edfa4cedf623 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:07.854872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:07.908991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:07.910022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:07.910564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:07.911061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:07.912391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:07.912937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:07.915608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:07.931227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 212/419] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:30:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:07.937354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398940b-bf27-4cba-ac91-87bf42b38b98 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:08.113366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398940b-bf27-4cba-ac91-87bf42b38b98 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:08.161685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8ba4a-5bed-4376-894a-c8288a6cb7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:08.162339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8ba4a-5bed-4376-894a-c8288a6cb7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:08.162644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8ba4a-5bed-4376-894a-c8288a6cb7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:08.162917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8ba4a-5bed-4376-894a-c8288a6cb7a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:08.165859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:08.274677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8ba4a-5bed-4376-894a-c8288a6cb7a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:08.276490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8ba4a-5bed-4376-894a-c8288a6cb7a0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:08.414685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 208/420] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:08.422074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:08.424298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955312-a6b3-46b2-8a5f-84c4c4c35390 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:08.424866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955312-a6b3-46b2-8a5f-84c4c4c35390 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:08.425373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955312-a6b3-46b2-8a5f-84c4c4c35390 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:08.427390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 209/421] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:08.433398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888b7e-2dad-4bc4-81e3-3df55870dddf None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:08.434045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888b7e-2dad-4bc4-81e3-3df55870dddf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:08.434593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888b7e-2dad-4bc4-81e3-3df55870dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:08.456091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ea888b7e-2dad-4bc4-81e3-3df55870dddf None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:08.457763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ea888b7e-2dad-4bc4-81e3-3df55870dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:08.498305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:08.582508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 210/422] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:08.660617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43622b-7025-4bfc-8c94-95dad8697a45 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:08.716216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1955-d1c2-4e35-b351-c3e8189d50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:08.717388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1955-d1c2-4e35-b351-c3e8189d50d5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:08.717901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1955-d1c2-4e35-b351-c3e8189d50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:08.718368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1955-d1c2-4e35-b351-c3e8189d50d5 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:08.720008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c1955-d1c2-4e35-b351-c3e8189d50d5 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:08.721845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c1955-d1c2-4e35-b351-c3e8189d50d5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:08.723951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 213/423] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:08 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:08.731021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea888b7e-2dad-4bc4-81e3-3df55870dddf None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:08.934388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea888b7e-2dad-4bc4-81e3-3df55870dddf None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:09.015522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcf155-10b1-4a04-81b8-7f7b973e5428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:09.016418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf155-10b1-4a04-81b8-7f7b973e5428 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:09.016832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf155-10b1-4a04-81b8-7f7b973e5428 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:09.017237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf155-10b1-4a04-81b8-7f7b973e5428 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:09.023824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcf155-10b1-4a04-81b8-7f7b973e5428 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:09.026575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcf155-10b1-4a04-81b8-7f7b973e5428 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:09.030001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 211/424] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:08 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:09.035985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1955-d1c2-4e35-b351-c3e8189d50d5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:09.115529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:09.144233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcf155-10b1-4a04-81b8-7f7b973e5428 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:09.210514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:09.225138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1955-d1c2-4e35-b351-c3e8189d50d5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:09.261767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf71976-e11a-4783-a58c-cc3459e629cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:09.262844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71976-e11a-4783-a58c-cc3459e629cb None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:09.263322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71976-e11a-4783-a58c-cc3459e629cb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:09.263897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf71976-e11a-4783-a58c-cc3459e629cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:09.264870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf71976-e11a-4783-a58c-cc3459e629cb None admin] RBAC: Adding query filter params (group.id=27007395fc674e14b7fff07aba7c2d0e, role.id=2284ec91b47444249d339c70801cd407, scope.project.id=1eda274b900241bf883d02a37e874f06) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:09.265427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf71976-e11a-4783-a58c-cc3459e629cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:09.267234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf71976-e11a-4783-a58c-cc3459e629cb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:09.274175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 214/425] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:30:09 2022] GET /identity/v3/role_assignments?group.id=27007395fc674e14b7fff07aba7c2d0e&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=2284ec91b47444249d339c70801cd407 => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:09.342988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15d47-4def-49a5-9b23-21a5151d09ec None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:09.343543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15d47-4def-49a5-9b23-21a5151d09ec None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:09.344025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15d47-4def-49a5-9b23-21a5151d09ec None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:09.347049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 215/426] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:09.355632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97641b8-eb22-492f-969a-54749d719afd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:09.356118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97641b8-eb22-492f-969a-54749d719afd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:09.356584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97641b8-eb22-492f-969a-54749d719afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:09.386716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcf155-10b1-4a04-81b8-7f7b973e5428 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:09.420394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d97641b8-eb22-492f-969a-54749d719afd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:09.422273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d97641b8-eb22-492f-969a-54749d719afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:09.459382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750593cd-e1f9-49cb-a8a7-85a806fa40e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:09.460470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750593cd-e1f9-49cb-a8a7-85a806fa40e4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:09.460948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750593cd-e1f9-49cb-a8a7-85a806fa40e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:09.461426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750593cd-e1f9-49cb-a8a7-85a806fa40e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:09.481530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750593cd-e1f9-49cb-a8a7-85a806fa40e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-750593cd-e1f9-49cb-a8a7-85a806fa40e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:09.491304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:09.492265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 14:30:09.493034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:09.495287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 212/427] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:09.506347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750593cd-e1f9-49cb-a8a7-85a806fa40e4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:09.569005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 216/428] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:09.723910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:09.735850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750593cd-e1f9-49cb-a8a7-85a806fa40e4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:09.782423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c43e2-91ee-4d96-8e87-a6eae932d451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:09.783074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c43e2-91ee-4d96-8e87-a6eae932d451 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:09.783353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c43e2-91ee-4d96-8e87-a6eae932d451 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:09.783625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c43e2-91ee-4d96-8e87-a6eae932d451 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:09.784322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c43e2-91ee-4d96-8e87-a6eae932d451 None admin] RBAC: Adding query filter params (name=member) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:09.784628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c43e2-91ee-4d96-8e87-a6eae932d451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:09.786628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c43e2-91ee-4d96-8e87-a6eae932d451 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:09.797871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 213/429] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:30:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:09.807634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97641b8-eb22-492f-969a-54749d719afd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:09.890161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:10.051055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97641b8-eb22-492f-969a-54749d719afd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:10.068004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d2143-4c32-4fa2-806b-05dac7f197a7 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.068556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d2143-4c32-4fa2-806b-05dac7f197a7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.068556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d2143-4c32-4fa2-806b-05dac7f197a7 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.069907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 214/430] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:10.075930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc24f4-0618-472b-b457-f701c9dc1b79 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.076228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc24f4-0618-472b-b457-f701c9dc1b79 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.076496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc24f4-0618-472b-b457-f701c9dc1b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.105983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-32dc24f4-0618-472b-b457-f701c9dc1b79 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:10.107356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-32dc24f4-0618-472b-b457-f701c9dc1b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:10.109585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b765aa-fcef-4503-b5ae-9674bf8aa238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:10.110232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b765aa-fcef-4503-b5ae-9674bf8aa238 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.110545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b765aa-fcef-4503-b5ae-9674bf8aa238 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.110819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b765aa-fcef-4503-b5ae-9674bf8aa238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.219344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b765aa-fcef-4503-b5ae-9674bf8aa238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:10.220763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b765aa-fcef-4503-b5ae-9674bf8aa238 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:10.223404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 215/431] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:10.224882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc24f4-0618-472b-b457-f701c9dc1b79 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:10.266703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:10.373092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:10.378861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 217/432] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 14:30:10.381166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db0eb-66e8-4788-b676-a0738c90876a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.381634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db0eb-66e8-4788-b676-a0738c90876a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.382092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db0eb-66e8-4788-b676-a0738c90876a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.384736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 218/433] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:10.392709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35db0eb-66e8-4788-b676-a0738c90876a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:10.400376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc24f4-0618-472b-b457-f701c9dc1b79 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:10.439002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4866b-9e42-4c29-b4db-306bef5e589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:10.439647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4866b-9e42-4c29-b4db-306bef5e589f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.439921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4866b-9e42-4c29-b4db-306bef5e589f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.440187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4866b-9e42-4c29-b4db-306bef5e589f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.453455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4866b-9e42-4c29-b4db-306bef5e589f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-0dc4866b-9e42-4c29-b4db-306bef5e589f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:10.458365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:10.460067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 216/434] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:30:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:10.461575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135d52-1337-4db8-8a88-9b4456526549 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.463079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135d52-1337-4db8-8a88-9b4456526549 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.463079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135d52-1337-4db8-8a88-9b4456526549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.491872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-38135d52-1337-4db8-8a88-9b4456526549 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:10.493783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-38135d52-1337-4db8-8a88-9b4456526549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:10.565487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35db0eb-66e8-4788-b676-a0738c90876a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:10.597757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 217/435] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:10.598981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38135d52-1337-4db8-8a88-9b4456526549 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:10.620998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:10.632492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef434ec-424b-4e5b-a55b-0b5638d3aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:10.634412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef434ec-424b-4e5b-a55b-0b5638d3aa67 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.635297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef434ec-424b-4e5b-a55b-0b5638d3aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.636261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef434ec-424b-4e5b-a55b-0b5638d3aa67 None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.638599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef434ec-424b-4e5b-a55b-0b5638d3aa67 None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:10.642004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef434ec-424b-4e5b-a55b-0b5638d3aa67 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:10.645963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 219/436] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:10 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:10.647669 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef434ec-424b-4e5b-a55b-0b5638d3aa67 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:10.730574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:10.767642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38135d52-1337-4db8-8a88-9b4456526549 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:10.786957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef434ec-424b-4e5b-a55b-0b5638d3aa67 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:10.829331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:10.829647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce2231-fbd1-4fa5-97da-f05f10175371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:10.830408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.830711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce2231-fbd1-4fa5-97da-f05f10175371 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:10.830863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.831176 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce2231-fbd1-4fa5-97da-f05f10175371 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:10.831325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.831650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce2231-fbd1-4fa5-97da-f05f10175371 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:10.832221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:10.832688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:10.834282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:10.849822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 218/437] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:10.849822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:10.857577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce2231-fbd1-4fa5-97da-f05f10175371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8fce2231-fbd1-4fa5-97da-f05f10175371 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:10.867716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:10.869310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:10.870582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 220/438] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:30:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:10.873864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce2231-fbd1-4fa5-97da-f05f10175371 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:10.966171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:10.995225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dde23c-b99a-4a92-bd0f-f97e6b700f1e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:11.038534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d5dde-40f3-4b21-9ec6-7cee5f0d8e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:11.039285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce2231-fbd1-4fa5-97da-f05f10175371 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:11.039609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5dde-40f3-4b21-9ec6-7cee5f0d8e36 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:11.040093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5dde-40f3-4b21-9ec6-7cee5f0d8e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:11.040575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5dde-40f3-4b21-9ec6-7cee5f0d8e36 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:11.042829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d5dde-40f3-4b21-9ec6-7cee5f0d8e36 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:11.045566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d5dde-40f3-4b21-9ec6-7cee5f0d8e36 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:11.048742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 219/439] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:10 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:11.050010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d5dde-40f3-4b21-9ec6-7cee5f0d8e36 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:11.055981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:11.101913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856075-28fc-48e0-b407-942cb0b226ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:11.102992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856075-28fc-48e0-b407-942cb0b226ac None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:11.103914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856075-28fc-48e0-b407-942cb0b226ac None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:11.104602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856075-28fc-48e0-b407-942cb0b226ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:11.180697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d5dde-40f3-4b21-9ec6-7cee5f0d8e36 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:11.217564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856075-28fc-48e0-b407-942cb0b226ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:11.220397 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856075-28fc-48e0-b407-942cb0b226ac None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:11.220782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:11.221406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:11.221682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:11.221950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:11.222653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:11.222954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:11.224333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:11.233240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 220/440] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:11.234115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:11.301969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:11.319167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:11.361429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a66b12-9632-44e5-b668-d1e2b7f55f33 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:11.373221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 221/441] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:11.374702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856075-28fc-48e0-b407-942cb0b226ac None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:11.400528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f2cf-bb38-4d1a-94ef-86bd9e2db183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:11.401604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f2cf-bb38-4d1a-94ef-86bd9e2db183 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:11.401938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f2cf-bb38-4d1a-94ef-86bd9e2db183 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:11.402209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993f2cf-bb38-4d1a-94ef-86bd9e2db183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:11.417000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993f2cf-bb38-4d1a-94ef-86bd9e2db183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7993f2cf-bb38-4d1a-94ef-86bd9e2db183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:11.422976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:11.424545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 221/442] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:11.425918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f2cf-bb38-4d1a-94ef-86bd9e2db183 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:11.515532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856075-28fc-48e0-b407-942cb0b226ac None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:11.569186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:11.570203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:11.570203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:11.570584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:11.571491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] RBAC: Adding query filter params (group.id=27007395fc674e14b7fff07aba7c2d0e, role.id=2284ec91b47444249d339c70801cd407, scope.project.id=b76ad539b19f499fa6232d0ca420603c) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:11.571891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:11.574126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:11.579243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993f2cf-bb38-4d1a-94ef-86bd9e2db183 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:11.581807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 222/443] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:30:11 2022] GET /identity/v3/role_assignments?group.id=27007395fc674e14b7fff07aba7c2d0e&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=2284ec91b47444249d339c70801cd407 => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:11.582718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:11.626918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:11.633186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:11.642844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecea47-601e-43cd-8127-e05e7b617ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:11.643681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecea47-601e-43cd-8127-e05e7b617ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:11.643681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecea47-601e-43cd-8127-e05e7b617ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:11.644127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecea47-601e-43cd-8127-e05e7b617ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:11.751883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c6e4-cd5f-430b-bcff-7108d992fad9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:11.769033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecea47-601e-43cd-8127-e05e7b617ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:11.770238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecea47-601e-43cd-8127-e05e7b617ae4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:11.812601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0bd53-3985-40f6-8b40-824a159b64f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:11.814296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0bd53-3985-40f6-8b40-824a159b64f8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:11.814781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0bd53-3985-40f6-8b40-824a159b64f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:11.815179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0bd53-3985-40f6-8b40-824a159b64f8 None admin] PATH_INFO: `/v3/projects/1eda274b900241bf883d02a37e874f06` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:11.816680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0bd53-3985-40f6-8b40-824a159b64f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1eda274b900241bf883d02a37e874f06)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:11.819272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0bd53-3985-40f6-8b40-824a159b64f8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:11.822084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 223/444] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:11 2022] GET /identity/v3/projects/1eda274b900241bf883d02a37e874f06 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:11.823392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0bd53-3985-40f6-8b40-824a159b64f8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:11.925310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 222/445] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:11.926684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecea47-601e-43cd-8127-e05e7b617ae4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:11.954729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:11.961437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:11.972667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0bd53-3985-40f6-8b40-824a159b64f8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.031194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.031981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.032329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.032826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.033921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:12.033921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.035439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:12.043853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecea47-601e-43cd-8127-e05e7b617ae4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.046011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 224/446] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:12.046949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:12.088519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067df42-9d3d-448f-a61e-41c1e3685410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.089521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067df42-9d3d-448f-a61e-41c1e3685410 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.090251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067df42-9d3d-448f-a61e-41c1e3685410 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.090470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067df42-9d3d-448f-a61e-41c1e3685410 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.092473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067df42-9d3d-448f-a61e-41c1e3685410 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.094799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067df42-9d3d-448f-a61e-41c1e3685410 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:12.096670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 223/447] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:11 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:12.097395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067df42-9d3d-448f-a61e-41c1e3685410 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:12.204603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3c8a9-a5ca-4056-9b68-748afb684165 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.207397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:12.216571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067df42-9d3d-448f-a61e-41c1e3685410 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.251410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bdccd-40f7-4168-aab1-825e09231e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.252312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bdccd-40f7-4168-aab1-825e09231e6d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.252753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bdccd-40f7-4168-aab1-825e09231e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.253138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bdccd-40f7-4168-aab1-825e09231e6d None admin] PATH_INFO: `/v3/projects/b76ad539b19f499fa6232d0ca420603c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.255067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bdccd-40f7-4168-aab1-825e09231e6d None admin] RBAC: Authorizing `identity:get_project(project_id=b76ad539b19f499fa6232d0ca420603c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.257670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bdccd-40f7-4168-aab1-825e09231e6d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:12.259005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636d8dc-88cb-485b-8e60-93005074bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.259955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d8dc-88cb-485b-8e60-93005074bf3f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.260429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d8dc-88cb-485b-8e60-93005074bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.260979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d8dc-88cb-485b-8e60-93005074bf3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.261506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 225/448] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:12 2022] GET /identity/v3/projects/b76ad539b19f499fa6232d0ca420603c => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:12.262584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bdccd-40f7-4168-aab1-825e09231e6d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:12.288340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:12.355448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636d8dc-88cb-485b-8e60-93005074bf3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.356822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636d8dc-88cb-485b-8e60-93005074bf3f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:12.386417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bdccd-40f7-4168-aab1-825e09231e6d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.449271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.450285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.450764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.451209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.452917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] RBAC: Adding query filter params (group.id=27007395fc674e14b7fff07aba7c2d0e, role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=1eda274b900241bf883d02a37e874f06) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:12.453476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.456252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:12.466924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:12.475584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 226/449] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:30:12 2022] GET /identity/v3/role_assignments?group.id=27007395fc674e14b7fff07aba7c2d0e&scope.project.id=1eda274b900241bf883d02a37e874f06&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:12.475584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:12.475983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 224/450] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:12.481821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636d8dc-88cb-485b-8e60-93005074bf3f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:12.632611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636d8dc-88cb-485b-8e60-93005074bf3f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.637683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:12.666994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efcf32-e1f2-49fb-8598-2b4775de3af7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.703788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293e36-2b18-451e-9f3a-dafcfe906312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.704784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293e36-2b18-451e-9f3a-dafcfe906312 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.705241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293e36-2b18-451e-9f3a-dafcfe906312 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.705710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f293e36-2b18-451e-9f3a-dafcfe906312 None admin] PATH_INFO: `/v3/projects/259468708afd445bab53811821f0bda0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.707670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f293e36-2b18-451e-9f3a-dafcfe906312 None admin] RBAC: Authorizing `identity:get_project(project_id=259468708afd445bab53811821f0bda0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.709934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f293e36-2b18-451e-9f3a-dafcfe906312 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:12.712427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 225/451] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:30:12 2022] GET /identity/v3/projects/259468708afd445bab53811821f0bda0 => generated 344 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:12.720709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ede0b-6b5b-45c2-9252-d29f433809a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.721373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ede0b-6b5b-45c2-9252-d29f433809a4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.721648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ede0b-6b5b-45c2-9252-d29f433809a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.721839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293e36-2b18-451e-9f3a-dafcfe906312 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:12.722003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ede0b-6b5b-45c2-9252-d29f433809a4 None admin] PATH_INFO: `/v3/groups/27007395fc674e14b7fff07aba7c2d0e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.723082 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ede0b-6b5b-45c2-9252-d29f433809a4 None admin] RBAC: Authorizing `identity:get_group(group_id=27007395fc674e14b7fff07aba7c2d0e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.724576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ede0b-6b5b-45c2-9252-d29f433809a4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:12.726853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 227/452] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:12 2022] GET /identity/v3/groups/27007395fc674e14b7fff07aba7c2d0e => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:12.734077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ede0b-6b5b-45c2-9252-d29f433809a4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:12.832453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:12.890310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f293e36-2b18-451e-9f3a-dafcfe906312 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.926328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ede0b-6b5b-45c2-9252-d29f433809a4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:12.961237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf47577-bc0c-4448-9e12-bc5c28040870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.962243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf47577-bc0c-4448-9e12-bc5c28040870 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.962882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf47577-bc0c-4448-9e12-bc5c28040870 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.963426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf47577-bc0c-4448-9e12-bc5c28040870 None admin] PATH_INFO: `/v3/groups/fd9ba3949b164a018e9e69ed6d28b0aa` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.966005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf47577-bc0c-4448-9e12-bc5c28040870 None admin] RBAC: Authorizing `identity:get_group(group_id=fd9ba3949b164a018e9e69ed6d28b0aa)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.968575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf47577-bc0c-4448-9e12-bc5c28040870 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:12.977204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 226/453] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Aug 30 14:30:12 2022] GET /identity/v3/groups/fd9ba3949b164a018e9e69ed6d28b0aa => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:12.979933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf47577-bc0c-4448-9e12-bc5c28040870 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:12.984045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f42c5-3d29-4252-8312-0cb8705a5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:12.985014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f42c5-3d29-4252-8312-0cb8705a5e46 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:12.985466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f42c5-3d29-4252-8312-0cb8705a5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:12.985888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f42c5-3d29-4252-8312-0cb8705a5e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:12.987257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f42c5-3d29-4252-8312-0cb8705a5e46 None admin] RBAC: Adding query filter params (group.id=27007395fc674e14b7fff07aba7c2d0e, role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=b76ad539b19f499fa6232d0ca420603c) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:12.987725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f42c5-3d29-4252-8312-0cb8705a5e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:12.990203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f42c5-3d29-4252-8312-0cb8705a5e46 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:13.001459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 228/454] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:30:12 2022] GET /identity/v3/role_assignments?group.id=27007395fc674e14b7fff07aba7c2d0e&scope.project.id=b76ad539b19f499fa6232d0ca420603c&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 611 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:13.175453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf47577-bc0c-4448-9e12-bc5c28040870 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:13.219593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:13.227779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564594b0-5b92-4533-88e6-52c97bd0bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:13.228711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564594b0-5b92-4533-88e6-52c97bd0bf29 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:13.229027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564594b0-5b92-4533-88e6-52c97bd0bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:13.229440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564594b0-5b92-4533-88e6-52c97bd0bf29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:13.230347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564594b0-5b92-4533-88e6-52c97bd0bf29 None admin] RBAC: Adding query filter params (group.id=fd9ba3949b164a018e9e69ed6d28b0aa, role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=259468708afd445bab53811821f0bda0) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:13.230821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564594b0-5b92-4533-88e6-52c97bd0bf29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:13.232490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564594b0-5b92-4533-88e6-52c97bd0bf29 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:13.241313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 227/455] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Aug 30 14:30:12 2022] GET /identity/v3/role_assignments?group.id=fd9ba3949b164a018e9e69ed6d28b0aa&scope.project.id=259468708afd445bab53811821f0bda0&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 611 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:16.118783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec8ec-dd6e-4c69-b6a9-c00c9de269c8 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:16.120501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec8ec-dd6e-4c69-b6a9-c00c9de269c8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:16.121280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ec8ec-dd6e-4c69-b6a9-c00c9de269c8 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:16.124685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 229/456] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:16.131103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ea1-5966-4285-bbb8-87751edbb935 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:16.132553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ea1-5966-4285-bbb8-87751edbb935 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:16.133299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ea1-5966-4285-bbb8-87751edbb935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:16.174488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ab8c8ea1-5966-4285-bbb8-87751edbb935 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:16.177143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ab8c8ea1-5966-4285-bbb8-87751edbb935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:16.348258 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 228/457] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:16.739314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2230ef-feb5-40ac-b528-062e7455302c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:16.739547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2230ef-feb5-40ac-b528-062e7455302c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:16.739897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2230ef-feb5-40ac-b528-062e7455302c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:16.741394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 230/458] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:16.748742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a676550-81c8-4620-90c7-39699c3f9d6d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:16.749166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a676550-81c8-4620-90c7-39699c3f9d6d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:16.749733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a676550-81c8-4620-90c7-39699c3f9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:16.789502 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8a676550-81c8-4620-90c7-39699c3f9d6d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:16.791925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8a676550-81c8-4620-90c7-39699c3f9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:16.901317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1da7-3458-4a94-9fda-541da7a943f0 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:16.901975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1da7-3458-4a94-9fda-541da7a943f0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:16.902535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1da7-3458-4a94-9fda-541da7a943f0 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:16.904535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 231/459] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:16.910532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82b6a6-1cee-4d0b-a9cf-39c01362c53c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:16.911151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82b6a6-1cee-4d0b-a9cf-39c01362c53c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:16.911615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82b6a6-1cee-4d0b-a9cf-39c01362c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:16.932568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 229/460] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:16.933330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3e82b6a6-1cee-4d0b-a9cf-39c01362c53c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:16.934932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3e82b6a6-1cee-4d0b-a9cf-39c01362c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:16.950726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:16.960769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a676550-81c8-4620-90c7-39699c3f9d6d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:17.108771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 232/461] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:17.136390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:17.212463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a676550-81c8-4620-90c7-39699c3f9d6d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:17.272208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:17.272858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:17.273131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:17.273399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:17.291410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:17.293003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:17.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:17.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:17.321171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:17.321171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:17.321171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:17.321171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 230/462] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:17.331629 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82b6a6-1cee-4d0b-a9cf-39c01362c53c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:17.434631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:17.529639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82b6a6-1cee-4d0b-a9cf-39c01362c53c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:17.576638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3c77e-32e1-426c-ab78-dcd76866d76d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:17.581978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61494f84-5095-4964-ae10-7b154edd9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:17.582794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61494f84-5095-4964-ae10-7b154edd9d42 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:17.583188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61494f84-5095-4964-ae10-7b154edd9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:17.583579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61494f84-5095-4964-ae10-7b154edd9d42 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:17.584357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61494f84-5095-4964-ae10-7b154edd9d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:17.585060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61494f84-5095-4964-ae10-7b154edd9d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:17.587033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:17.587330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61494f84-5095-4964-ae10-7b154edd9d42 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:17.603130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 233/463] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:17.612048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8bd01-1926-42b7-bb0e-3b5950f2d8de None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:17.612470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8bd01-1926-42b7-bb0e-3b5950f2d8de None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:17.612867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8bd01-1926-42b7-bb0e-3b5950f2d8de None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:17.614935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 234/464] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:17.615899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8bd01-1926-42b7-bb0e-3b5950f2d8de None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:17.630230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:17.632158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:17.633191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:17.634033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:17.634827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:17.652523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:17.655185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:17.676619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:17.678299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:17.679938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:17.679938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:17.679938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:17.685231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 231/465] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:17.686127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:17.760738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8bd01-1926-42b7-bb0e-3b5950f2d8de None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:17.808607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a7be2-74d9-4370-9979-dfe7c1f9f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:17.809593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7be2-74d9-4370-9979-dfe7c1f9f502 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:17.810067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7be2-74d9-4370-9979-dfe7c1f9f502 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:17.810556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7be2-74d9-4370-9979-dfe7c1f9f502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:17.815530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5cc03-2a13-4c12-adad-249942216ea7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:17.828007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a7be2-74d9-4370-9979-dfe7c1f9f502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:17.830536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a7be2-74d9-4370-9979-dfe7c1f9f502 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-320a7be2-74d9-4370-9979-dfe7c1f9f502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:17.854697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:17.856353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:17.859089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:17.859089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:17.859089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:17.859089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 235/466] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:17.859089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759928d3-8272-4166-aee3-6f70240157cd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:17.859089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759928d3-8272-4166-aee3-6f70240157cd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:17.859089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759928d3-8272-4166-aee3-6f70240157cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:17.865908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca55f-40ab-48a0-8ad9-3b732cfe5f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:17.867811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca55f-40ab-48a0-8ad9-3b732cfe5f8a None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:17.868419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca55f-40ab-48a0-8ad9-3b732cfe5f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:17.868836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca55f-40ab-48a0-8ad9-3b732cfe5f8a None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:17.869644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ca55f-40ab-48a0-8ad9-3b732cfe5f8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:17.871324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ca55f-40ab-48a0-8ad9-3b732cfe5f8a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:17.878663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-759928d3-8272-4166-aee3-6f70240157cd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:17.879940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-759928d3-8272-4166-aee3-6f70240157cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:17.900730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 232/467] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:30:17 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:30:17.904931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca55f-40ab-48a0-8ad9-3b732cfe5f8a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:17.946740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:17.959347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:17.981246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 236/468] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:17.982499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759928d3-8272-4166-aee3-6f70240157cd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:18.079986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca55f-40ab-48a0-8ad9-3b732cfe5f8a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:18.131355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:18.132135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:18.132617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:18.132796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:18.133353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:18.133660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:18.135476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:18.163539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 233/469] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:18.172593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:18.218051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759928d3-8272-4166-aee3-6f70240157cd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:18.283018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0677c-1194-43c4-b020-2b2494a65f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:18.283654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0677c-1194-43c4-b020-2b2494a65f6a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:18.283927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0677c-1194-43c4-b020-2b2494a65f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:18.284198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0677c-1194-43c4-b020-2b2494a65f6a None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:18.284857 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0677c-1194-43c4-b020-2b2494a65f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:18.285156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0677c-1194-43c4-b020-2b2494a65f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:18.286988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0677c-1194-43c4-b020-2b2494a65f6a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:18.301111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 237/470] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:18.302543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774f5b-b130-4f70-bc94-f90bfb43d62e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:18.302826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774f5b-b130-4f70-bc94-f90bfb43d62e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:18.303097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be774f5b-b130-4f70-bc94-f90bfb43d62e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:18.308951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 238/471] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:18.310593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf495-42dc-45d6-b4e1-d36766fee7cd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:18.310771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf495-42dc-45d6-b4e1-d36766fee7cd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:18.311016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf495-42dc-45d6-b4e1-d36766fee7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:18.333382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-89ecf495-42dc-45d6-b4e1-d36766fee7cd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:18.334615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-89ecf495-42dc-45d6-b4e1-d36766fee7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:18.344016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:18.383730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e35ea4-adf1-4635-ab61-fce6fb6675f3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:18.423486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:18.436200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e53de1-96e2-4b6f-8ab4-774d76003989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:18.437196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53de1-96e2-4b6f-8ab4-774d76003989 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:18.437646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53de1-96e2-4b6f-8ab4-774d76003989 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:18.438115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e53de1-96e2-4b6f-8ab4-774d76003989 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:18.439356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e53de1-96e2-4b6f-8ab4-774d76003989 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:18.442035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e53de1-96e2-4b6f-8ab4-774d76003989 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:18.450358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 239/472] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:18.454651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf495-42dc-45d6-b4e1-d36766fee7cd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:18.484254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 234/473] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:30:18 2022] POST /identity/v3/users => generated 246 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:30:18.486070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e53de1-96e2-4b6f-8ab4-774d76003989 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:18.565518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf495-42dc-45d6-b4e1-d36766fee7cd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:18.632395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111a4c-104c-4541-a333-d9a2da13c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:18.633311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111a4c-104c-4541-a333-d9a2da13c59e None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:18.633769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111a4c-104c-4541-a333-d9a2da13c59e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:18.634183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111a4c-104c-4541-a333-d9a2da13c59e None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:18.635116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15111a4c-104c-4541-a333-d9a2da13c59e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:18.636785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15111a4c-104c-4541-a333-d9a2da13c59e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:18.686405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e53de1-96e2-4b6f-8ab4-774d76003989 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:18.689603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 240/474] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:30:18 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:30:18.737552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111a4c-104c-4541-a333-d9a2da13c59e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:18.741763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:18.759098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:18.759098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:18.759098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:18.759098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:18.781191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:18.784180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:18.813435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:18.814430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:18.815377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:18.815377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:18.815377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:18.815377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 235/475] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:18.823160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:18.825045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:18.932288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111a4c-104c-4541-a333-d9a2da13c59e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:18.991090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:18.991642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:18.992072 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:18.992352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:18.993196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:18.995496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:19.006277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.sql.core [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:30:19.006277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 14:30:19.006277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [parameters: {'id': '83b4c6ae5b9946e4b867ab0ea1949db6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 14:30:19.006277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81723) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:30:19.025034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af762160-5809-4249-a06d-75c8fd4de342 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Aug 30 14:30:19.035019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:30:19.035961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application yield resource Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise self.value Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application session.commit() Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:30:19.036818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:30:19.037637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:30:19.038484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:30:19.039282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [parameters: {'id': '83b4c6ae5b9946e4b867ab0ea1949db6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:19.040039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 14:30:19.040852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:19.041662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 241/476] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Aug 30 14:30:18 2022] POST /identity/v3/roles => generated 144 bytes in 301 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:19.045699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:19.115648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:19.117018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:19.117506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:19.118328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:19.120199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:19.120694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:19.123297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:19.148754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 236/477] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:19.156412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:19.206869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:19.213293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e126b8-3491-4105-a4ba-3ba5ace23217 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:19.257755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:19.286150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8b793-7d46-424f-84cd-580990de2c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:19.286852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8b793-7d46-424f-84cd-580990de2c0c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:19.287151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8b793-7d46-424f-84cd-580990de2c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:19.287407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8b793-7d46-424f-84cd-580990de2c0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:19.310161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8b793-7d46-424f-84cd-580990de2c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-09d8b793-7d46-424f-84cd-580990de2c0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:19.318248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:19.319980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 14:30:19.321390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:19.324615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 242/478] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:30:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:19.332163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8b793-7d46-424f-84cd-580990de2c0c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:19.376613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ae09-37e5-4b52-b7a0-c2411dc8c097 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:19.453617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ae6cf-0ecf-4a19-ac1e-50ab5d0ca0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:19.455213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ae6cf-0ecf-4a19-ac1e-50ab5d0ca0a1 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:19.455781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ae6cf-0ecf-4a19-ac1e-50ab5d0ca0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:19.457628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ae6cf-0ecf-4a19-ac1e-50ab5d0ca0a1 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:19.459103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ae6cf-0ecf-4a19-ac1e-50ab5d0ca0a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:19.460922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ae6cf-0ecf-4a19-ac1e-50ab5d0ca0a1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:19.509435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 237/479] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:30:19 2022] POST /identity/v3/users => generated 249 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:30:19.623321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8b793-7d46-424f-84cd-580990de2c0c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:19.736260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efac2f7-e66b-4a2e-acda-e655084f4e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:19.737280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efac2f7-e66b-4a2e-acda-e655084f4e10 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:19.737754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efac2f7-e66b-4a2e-acda-e655084f4e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:19.738214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efac2f7-e66b-4a2e-acda-e655084f4e10 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:19.739145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efac2f7-e66b-4a2e-acda-e655084f4e10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:19.739690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efac2f7-e66b-4a2e-acda-e655084f4e10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:19.750482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efac2f7-e66b-4a2e-acda-e655084f4e10 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:19.773061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 243/480] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:21.468255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0304929-ebf7-4e0d-8712-a7efb5095ff6 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:21.468834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0304929-ebf7-4e0d-8712-a7efb5095ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:21.469174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0304929-ebf7-4e0d-8712-a7efb5095ff6 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:21.472180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 238/481] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:21.480488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a1f13-a8aa-4465-a040-f45ef44b21fc None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:21.481400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a1f13-a8aa-4465-a040-f45ef44b21fc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:21.481851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a1f13-a8aa-4465-a040-f45ef44b21fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:21.525049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b67a1f13-a8aa-4465-a040-f45ef44b21fc None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:21.527719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b67a1f13-a8aa-4465-a040-f45ef44b21fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:21.569028 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:21.651439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 244/482] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:21.704433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d582-3547-4440-9068-dc3781eae1ec None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:21.705053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d582-3547-4440-9068-dc3781eae1ec None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:21.705542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d582-3547-4440-9068-dc3781eae1ec None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:21.707436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 239/483] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:21.713356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193369-0147-40fd-8a93-20ed81e7703c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:21.713688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193369-0147-40fd-8a93-20ed81e7703c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:21.714089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193369-0147-40fd-8a93-20ed81e7703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:21.741207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a9193369-0147-40fd-8a93-20ed81e7703c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:21.742435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a9193369-0147-40fd-8a93-20ed81e7703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:21.830565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 245/484] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:21.918866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303ba1c-2d92-4dfd-ba2c-e9cf8ef01f7e None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:21.919359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303ba1c-2d92-4dfd-ba2c-e9cf8ef01f7e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:21.919838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303ba1c-2d92-4dfd-ba2c-e9cf8ef01f7e None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:21.922742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 240/485] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:21.927999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdfe3-c532-431d-9a13-29daa1d5ef5e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:21.928274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdfe3-c532-431d-9a13-29daa1d5ef5e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:21.929064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdfe3-c532-431d-9a13-29daa1d5ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:21.952672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7effdfe3-c532-431d-9a13-29daa1d5ef5e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:21.954110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7effdfe3-c532-431d-9a13-29daa1d5ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:22.046478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 246/486] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:22.189256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303ba1c-2d92-4dfd-ba2c-e9cf8ef01f7e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:22.315132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:22.323898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303ba1c-2d92-4dfd-ba2c-e9cf8ef01f7e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:22.352736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effdfe3-c532-431d-9a13-29daa1d5ef5e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:22.366408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0785-4260-4bc2-a93f-17d66462baa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:22.367126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0785-4260-4bc2-a93f-17d66462baa0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:22.367461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0785-4260-4bc2-a93f-17d66462baa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:22.367713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0785-4260-4bc2-a93f-17d66462baa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:22.379641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f0785-4260-4bc2-a93f-17d66462baa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-cf0f0785-4260-4bc2-a93f-17d66462baa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:22.384842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:22.387731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:22.389346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 241/487] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:22.401634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:22.419515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0785-4260-4bc2-a93f-17d66462baa0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:22.642473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effdfe3-c532-431d-9a13-29daa1d5ef5e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:22.686445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0785-4260-4bc2-a93f-17d66462baa0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:22.711218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4983-2538-4304-8ae5-3b3b0defe266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:22.712482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4983-2538-4304-8ae5-3b3b0defe266 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:22.713873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4983-2538-4304-8ae5-3b3b0defe266 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:22.714527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4983-2538-4304-8ae5-3b3b0defe266 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:22.735350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb4983-2538-4304-8ae5-3b3b0defe266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-b9fb4983-2538-4304-8ae5-3b3b0defe266 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:22.746894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:22.748863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:22.750544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:22.751757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 247/488] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:22.758189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4983-2538-4304-8ae5-3b3b0defe266 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:22.769674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:22.771115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:22.771881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:22.772290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:22.773425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:22.773965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:22.777206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:22.801109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 242/489] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:22.801109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:22.848295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:22.908662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:22.969670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4983-2538-4304-8ae5-3b3b0defe266 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:23.007022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d9fe-9b35-496e-ad33-b19158955e5b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:23.014414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ab01e-a0ce-403e-8a66-e39be19fe756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:23.015266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ab01e-a0ce-403e-8a66-e39be19fe756 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.015667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ab01e-a0ce-403e-8a66-e39be19fe756 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.016087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ab01e-a0ce-403e-8a66-e39be19fe756 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.031196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ab01e-a0ce-403e-8a66-e39be19fe756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-115ab01e-a0ce-403e-8a66-e39be19fe756 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:23.037630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:23.038623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:23.039400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:23.043130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 248/490] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:23.045724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ab01e-a0ce-403e-8a66-e39be19fe756 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:23.066568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650dda9-0486-40b3-b61e-ac18f5895fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:23.067390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dda9-0486-40b3-b61e-ac18f5895fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.067783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dda9-0486-40b3-b61e-ac18f5895fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.068173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650dda9-0486-40b3-b61e-ac18f5895fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.068986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650dda9-0486-40b3-b61e-ac18f5895fc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:23.069434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650dda9-0486-40b3-b61e-ac18f5895fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:23.071082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650dda9-0486-40b3-b61e-ac18f5895fc6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:23.090096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 243/491] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:23.090096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207eae7-8a10-47c5-b758-726326567f8a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.090096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207eae7-8a10-47c5-b758-726326567f8a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.090096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207eae7-8a10-47c5-b758-726326567f8a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.090096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 244/492] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:23.090855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207eae7-8a10-47c5-b758-726326567f8a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:23.210988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:23.234486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ab01e-a0ce-403e-8a66-e39be19fe756 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:23.246911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207eae7-8a10-47c5-b758-726326567f8a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:23.286188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:23.297877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a850d2-dd14-422b-a812-4b51669ffe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:23.299199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a850d2-dd14-422b-a812-4b51669ffe4b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.299652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a850d2-dd14-422b-a812-4b51669ffe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.300128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a850d2-dd14-422b-a812-4b51669ffe4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.309439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:23.310513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.311003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.311493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.313579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:23.314646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:23.316872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a850d2-dd14-422b-a812-4b51669ffe4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:23.317170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:23.318815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a850d2-dd14-422b-a812-4b51669ffe4b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:23.338928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 245/493] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:23.338928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-e7a850d2-dd14-422b-a812-4b51669ffe4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:23.340131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:23.341754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:23.343409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:23.343409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:23.343409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:23.346860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 249/494] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:23.348948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66114bb-08c4-4f15-81c8-4d2c76be0273 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.349364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66114bb-08c4-4f15-81c8-4d2c76be0273 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.349758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66114bb-08c4-4f15-81c8-4d2c76be0273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.369644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d66114bb-08c4-4f15-81c8-4d2c76be0273 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:23.370894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d66114bb-08c4-4f15-81c8-4d2c76be0273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:23.477180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 250/495] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:23.478523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66114bb-08c4-4f15-81c8-4d2c76be0273 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:23.531597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28234a-a2ed-405c-ab52-18aecf20c998 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:23.603220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:23.605221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.606459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.607205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.619584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66114bb-08c4-4f15-81c8-4d2c76be0273 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:23.628273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:23.629947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:23.633504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:23.647243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:23.651777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:23.653474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:23.656298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:23.656298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:23.656298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:23.656298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 246/496] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:23.656298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:23.690940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0980-aae0-4378-b3ae-f2fa20da8897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:23.691748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0980-aae0-4378-b3ae-f2fa20da8897 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.692140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0980-aae0-4378-b3ae-f2fa20da8897 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.692586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0980-aae0-4378-b3ae-f2fa20da8897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.706995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0980-aae0-4378-b3ae-f2fa20da8897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:23.708755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0980-aae0-4378-b3ae-f2fa20da8897 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-38ee0980-aae0-4378-b3ae-f2fa20da8897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:23.726843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:23.728766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:23.732077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:23.732077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:23.732077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:23.732077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 251/497] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:23.732077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0656c-05ab-46a4-a2c9-0121fee1f62d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.732077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0656c-05ab-46a4-a2c9-0121fee1f62d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.732077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0656c-05ab-46a4-a2c9-0121fee1f62d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.736005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 252/498] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:23.737043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0656c-05ab-46a4-a2c9-0121fee1f62d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:23.818191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e269ab-7416-4659-bd5a-816a6f0e7672 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:23.860908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11d23a-fef3-4275-9e84-3eba17c7a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:23.861523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11d23a-fef3-4275-9e84-3eba17c7a556 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.861797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11d23a-fef3-4275-9e84-3eba17c7a556 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.862063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11d23a-fef3-4275-9e84-3eba17c7a556 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.862738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11d23a-fef3-4275-9e84-3eba17c7a556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:23.863035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11d23a-fef3-4275-9e84-3eba17c7a556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:23.864424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11d23a-fef3-4275-9e84-3eba17c7a556 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:23.877224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 247/499] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:23.878517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab29a1-addf-4145-9d08-355ece030c11 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.878799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab29a1-addf-4145-9d08-355ece030c11 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.879068 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab29a1-addf-4145-9d08-355ece030c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.886231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0656c-05ab-46a4-a2c9-0121fee1f62d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:23.897285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-42ab29a1-addf-4145-9d08-355ece030c11 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:23.899073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-42ab29a1-addf-4145-9d08-355ece030c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:23.937503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864c40d-092d-4478-a040-45152dade90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:23.938173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864c40d-092d-4478-a040-45152dade90e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:23.938523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864c40d-092d-4478-a040-45152dade90e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:23.938760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864c40d-092d-4478-a040-45152dade90e None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:23.939413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864c40d-092d-4478-a040-45152dade90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:23.939703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864c40d-092d-4478-a040-45152dade90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:23.941163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864c40d-092d-4478-a040-45152dade90e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:23.959269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 253/500] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:23.959269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864c40d-092d-4478-a040-45152dade90e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:23.961561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:23.981234 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 248/501] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:23.981907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:23.982043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab29a1-addf-4145-9d08-355ece030c11 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:24.151921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864c40d-092d-4478-a040-45152dade90e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:24.161633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab29a1-addf-4145-9d08-355ece030c11 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:24.212972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:24.213722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:24.214075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:24.214340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:24.215059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:24.215355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:24.216825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:24.227720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:24.229172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:24.229684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:24.230200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:24.239829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 254/502] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:24.239829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:24.246837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:24.249313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:24.270262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:24.272187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:24.274093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:24.274093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:24.274093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:24.274093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 249/503] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:24.276125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:24.322983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:24.367800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:24.389386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b38fe6-d7a7-43e2-b587-594eb00cc44c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:24.405053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2b57-2f6e-400d-aed4-ae0155ab52ea None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:24.437303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:24.438091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:24.438491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:24.438858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:24.448893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:24.449163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:24.449644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:24.449920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:24.450188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:24.451018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:24.459144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:24.460798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:24.465362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:24.467319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 255/504] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:24.469186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:24.486905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:24.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 250/505] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:24.491259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:24.621116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38978e3-614a-4978-afaf-542c7141da16 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:24.631964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:24.639599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad43ce-26f3-480c-b8ae-265e5161e9e2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:24.664139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:24.665143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:24.665576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:24.666155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:24.679525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:24.682121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:24.703074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:24.704646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:30:24.706144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:24.707738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687b5f4-c6ff-48e7-a833-27dc4de51307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:24.707738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687b5f4-c6ff-48e7-a833-27dc4de51307 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:24.708037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 256/506] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:30:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:24.708173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687b5f4-c6ff-48e7-a833-27dc4de51307 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:24.708173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687b5f4-c6ff-48e7-a833-27dc4de51307 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:24.708418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:24.716958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:24.724768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687b5f4-c6ff-48e7-a833-27dc4de51307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7687b5f4-c6ff-48e7-a833-27dc4de51307 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:24.731488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:24.733404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:24.734999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 251/507] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:24.736305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687b5f4-c6ff-48e7-a833-27dc4de51307 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:24.859453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ec5f2-4028-4ace-8cf2-498b28dded82 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:24.876550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687b5f4-c6ff-48e7-a833-27dc4de51307 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:24.906423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:24.906725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:24.906872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:24.907148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:24.907805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:24.908108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:24.909614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:24.918899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:24.919677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:24.920038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:24.920388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:24.921498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:24.921879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:24.924122 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:24.930835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 257/508] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:24.930835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:24.994404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 252/509] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Aug 30 14:30:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:24.994404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:25.025546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:25.034544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:25.099960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ee78-9c39-41ab-93bc-dcce0a59a081 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:25.140735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:25.141260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:25.141584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:25.141854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:25.142627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:25.142929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:25.144417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:25.185781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 258/510] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Aug 30 14:30:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:25.186667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:25.190825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b525a9-503d-4ba4-b5ca-02f55e616bf8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:25.241244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:25.241864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:25.242142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:25.242440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:25.243245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:25.243554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:25.245601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:25.267562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 253/511] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:30:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:25.268844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:25.352900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bc94c-75ad-49dd-9fce-475e0bae60d2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:25.388246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:25.395996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:25.426024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:25.426830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:25.427136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:25.427433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:25.428113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:25.428503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:25.430836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:25.443937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 259/512] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:25.445589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37621f8f-06e8-46ac-8844-b9b5608b34eb None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:25.450123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:25.524640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543a53-9190-4a87-9e61-beba72c8855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:25.524640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543a53-9190-4a87-9e61-beba72c8855a None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:25.524907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543a53-9190-4a87-9e61-beba72c8855a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:25.525514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543a53-9190-4a87-9e61-beba72c8855a None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:25.526308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543a53-9190-4a87-9e61-beba72c8855a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:25.532143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543a53-9190-4a87-9e61-beba72c8855a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:25.574981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 254/513] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:30:25 2022] POST /identity/v3/users => generated 247 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:30:25.574981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543a53-9190-4a87-9e61-beba72c8855a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:25.652584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac3e5-0ac3-46a4-8631-8ab89943ec09 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:25.728764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7e09-af20-4627-932c-8d31141bd215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:25.729768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7e09-af20-4627-932c-8d31141bd215 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:25.730198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7e09-af20-4627-932c-8d31141bd215 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:25.730741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7e09-af20-4627-932c-8d31141bd215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:25.823778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543a53-9190-4a87-9e61-beba72c8855a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:25.871027 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:25.904792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:25.910800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7e09-af20-4627-932c-8d31141bd215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:25.912314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec47e2a-b1e8-4d69-a6a6-76e8276e4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:25.913223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47e2a-b1e8-4d69-a6a6-76e8276e4da2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:25.913657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7e09-af20-4627-932c-8d31141bd215 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:25.913826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47e2a-b1e8-4d69-a6a6-76e8276e4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:25.913959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47e2a-b1e8-4d69-a6a6-76e8276e4da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:26.008154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec47e2a-b1e8-4d69-a6a6-76e8276e4da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:26.009859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec47e2a-b1e8-4d69-a6a6-76e8276e4da2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:26.114461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 260/514] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:26.114461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7e09-af20-4627-932c-8d31141bd215 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:26.224703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 255/515] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:26.225912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec47e2a-b1e8-4d69-a6a6-76e8276e4da2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:26.276439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:26.281460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:26.304471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7e09-af20-4627-932c-8d31141bd215 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:26.346201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d36a9-9542-4f90-bfb9-14de41aaa431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:26.347576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d36a9-9542-4f90-bfb9-14de41aaa431 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:26.347576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d36a9-9542-4f90-bfb9-14de41aaa431 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:26.347796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d36a9-9542-4f90-bfb9-14de41aaa431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:26.384089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec47e2a-b1e8-4d69-a6a6-76e8276e4da2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:26.428187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:26.428900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:26.429222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:26.429538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:26.442978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:26.444471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:26.455250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d36a9-9542-4f90-bfb9-14de41aaa431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:26.456769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d36a9-9542-4f90-bfb9-14de41aaa431 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:26.463633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:26.465366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:26.467727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:26.467727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:26.467727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:26.467727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 256/516] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:26.467727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:26.587793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:26.600554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:26.622265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413725e4-7ee6-4729-bc58-8430729c3c29 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:26.630048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 261/517] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:26.630048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d36a9-9542-4f90-bfb9-14de41aaa431 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:26.685619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:26.686727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:26.687249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:26.687752 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:26.705111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:26.707636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:26.730446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:26.732170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:26.733827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:26.733827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:26.733827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:26.733827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 257/518] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:26.733827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:26.796482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d36a9-9542-4f90-bfb9-14de41aaa431 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:26.847427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:26.848512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:26.848963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:26.849736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:26.875734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:26.878665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:26.894192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0026fab-c39d-44a9-87a6-b76b00f19fa1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:26.903301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:26.905038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:26.907387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:26.907387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:26.907387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:26.907387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 262/519] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:26.907387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:26.950658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:26.962312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:26.963601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:26.964109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:26.964834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:26.966136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:26.967527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:26.971642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:26.973117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:26.996295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 258/520] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:26.997934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:27.063558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1cee0-7a22-4cfc-9727-91076940ed64 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:27.131403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:27.132483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:27.133025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:27.134071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:27.149861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bd3e5-0caa-4ebd-8535-90b8c2fe7fbb None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:27.152672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:27.155381 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:27.183671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:27.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:27.185889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:27.185889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:27.185889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:27.185889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 263/521] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:27.188214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:27.207017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:27.207839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:27.208255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:27.208853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:27.209717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:27.210212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:27.212135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:27.227203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 259/522] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:27.232507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:27.321174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:27.362180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:27.385925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437022a-1519-41b4-8246-ce91c98ced2f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:27.402254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a745-f0b5-4ab5-98c0-9b62aa80017c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:27.450052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:27.451082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:27.451578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:27.452356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:27.457921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:27.459014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:27.459525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:27.459996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:27.461170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:27.461697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:27.462991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:27.464646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:27.464956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:27.478932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:27.480870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:30:27.482860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:27.484882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 260/523] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:27.486439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:27.490299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 264/524] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:27.492157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:27.653060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00722124-5c04-4761-9ced-b4ae464e2781 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:27.660425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c593ae-5bac-4012-8110-9a16a620982d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:27.678776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:27.707585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:27.708601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:27.709034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:27.709800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:27.711066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:27.711544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:27.713398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:27.722159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:27.723246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:27.723752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:27.724236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:27.729688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 261/525] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:27.730877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:27.746500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:27.749213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:27.772739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:27.773724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:27.775393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 265/526] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:27.776297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:27.796884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:27.878283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073768-9cbb-4b01-84df-73681938c1fa None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:27.931800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:27.932809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:27.933247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:27.933673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:27.934675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:27.935147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:27.937542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:27.967076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2942-e7f2-4f05-8037-7c52bfe8fe31 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:27.977711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 262/527] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Aug 30 14:30:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:27.977711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:28.019917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:28.031096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:28.032078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:28.032508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:28.032922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:28.045413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:28.047835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:28.066613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:28.068284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 266/528] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:28.069741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:28.154507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3e242-2c29-4045-9a0e-7cbace7c848f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:28.189981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:28.222345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:28.223859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:28.224319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:28.224797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:28.237515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:28.238336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb5712-7393-445f-a73d-cfd13768c38e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:28.240213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:28.263125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:28.264867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:28.266480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 263/529] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:28.267493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:28.296894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:28.297688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:28.298102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:28.298585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:28.299994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:28.300480 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:28.303016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:28.337577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 267/530] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:28.339523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:28.423896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:28.440126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e0f4e-75c3-4422-87a6-bbe023626d07 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:28.489415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a01fc9-8ea5-4598-9b1a-4e62a4f1403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:28.490189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a01fc9-8ea5-4598-9b1a-4e62a4f1403b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:28.490603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a01fc9-8ea5-4598-9b1a-4e62a4f1403b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:28.490969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a01fc9-8ea5-4598-9b1a-4e62a4f1403b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:28.532856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acb2b9-248d-486e-9f1b-16b988adc14b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:28.567018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:28.578097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:28.578843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:28.579272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:28.579599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:28.580474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:28.580934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:28.583452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:28.600703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a01fc9-8ea5-4598-9b1a-4e62a4f1403b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:28.602013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 268/531] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:28.602535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a01fc9-8ea5-4598-9b1a-4e62a4f1403b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:28.603232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:28.742514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:28.754440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 264/532] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:28.754669 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba4e8-acd1-47d7-af77-89d112eb15bb None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:28.755229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a01fc9-8ea5-4598-9b1a-4e62a4f1403b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:28.800681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063aeb8-0897-4f84-9c26-a577050a8212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:28.801290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063aeb8-0897-4f84-9c26-a577050a8212 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:28.801564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063aeb8-0897-4f84-9c26-a577050a8212 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:28.801825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063aeb8-0897-4f84-9c26-a577050a8212 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:28.802556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063aeb8-0897-4f84-9c26-a577050a8212 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:28.802858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063aeb8-0897-4f84-9c26-a577050a8212 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:28.804352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063aeb8-0897-4f84-9c26-a577050a8212 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:28.819133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 269/533] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:28.820426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8d2e-bee3-43be-8495-275844be2dcf None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:28.820702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8d2e-bee3-43be-8495-275844be2dcf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:28.820973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d8d2e-bee3-43be-8495-275844be2dcf None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:28.822259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 270/534] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:28.823255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d8d2e-bee3-43be-8495-275844be2dcf None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:28.884140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a01fc9-8ea5-4598-9b1a-4e62a4f1403b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:28.890118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:28.926344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:28.927001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:28.927271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:28.927543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:28.928287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=89357dc69c8f456580613061f2cbef07) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:28.928589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:28.930044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:28.943753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 265/535] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:28 2022] GET /identity/v3/role_assignments?user.id=89357dc69c8f456580613061f2cbef07&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:28.943753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:28.968986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d8d2e-bee3-43be-8495-275844be2dcf None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:29.041244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:29.042462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:29.042789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:29.043146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:29.044375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=a725ee4d8b0b4524ad8484c3255f75da) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:29.044873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:29.047572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:29.048319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:29.066701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 271/536] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:28 2022] GET /identity/v3/role_assignments?user.id=a725ee4d8b0b4524ad8484c3255f75da&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:29.066701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:29.135955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff864b6-660c-4e86-8eb8-b65261a91d9a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:29.199076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3b135-e38e-44ca-9874-e5b2e378b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:29.200312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3b135-e38e-44ca-9874-e5b2e378b665 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:29.201056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3b135-e38e-44ca-9874-e5b2e378b665 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:29.201647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3b135-e38e-44ca-9874-e5b2e378b665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:29.216857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3b135-e38e-44ca-9874-e5b2e378b665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:29.218830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3b135-e38e-44ca-9874-e5b2e378b665 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-faa3b135-e38e-44ca-9874-e5b2e378b665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:29.236642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:29.237873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:29.238952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:29.238952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:29.238952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:29.245235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 266/537] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:29.246401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eba4ca-75a8-4a98-aad7-39fe106ac5ba None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:29.246785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eba4ca-75a8-4a98-aad7-39fe106ac5ba None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:29.247147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eba4ca-75a8-4a98-aad7-39fe106ac5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:29.253538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e06144-d0c4-4b9c-9115-067e8c2874db None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:29.275971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-79eba4ca-75a8-4a98-aad7-39fe106ac5ba None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:29.277253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-79eba4ca-75a8-4a98-aad7-39fe106ac5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:29.291019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:29.310967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:29.311986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:29.312266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:29.318413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:29.318413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=906464ed50294dc481c4d1d570a5195b) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:29.318413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:29.318413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:29.326772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 272/538] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:29 2022] GET /identity/v3/role_assignments?user.id=906464ed50294dc481c4d1d570a5195b&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:29.329111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:29.456256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 267/539] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:29.582477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a66a62-8766-42b0-a921-a733a1f01277 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:29.655916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:29.657092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:29.657578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:29.658129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:29.659339 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:29.659893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:29.662658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:29.686439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 273/540] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:29.691656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eba4ca-75a8-4a98-aad7-39fe106ac5ba None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:29.755157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:29.884916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eba4ca-75a8-4a98-aad7-39fe106ac5ba None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:29.960709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:29.961380 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:29.961655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:29.961922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:29.980083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:29.981589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:29.999565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:30.003646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:30.004624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:30.005544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 268/541] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:30.011524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:30.081339 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:30.235986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337e0fe-6dce-4350-9015-fcc1fb92d35f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:30.268046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:30.272644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893219fe-5570-4ad1-9fe1-a97ac1aac6ee None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:30.334000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c41f-a633-4128-b08e-2baab3cadced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:30.338403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c41f-a633-4128-b08e-2baab3cadced None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:30.338403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c41f-a633-4128-b08e-2baab3cadced None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:30.338403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c41f-a633-4128-b08e-2baab3cadced None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:30.356087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:30.356644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:30.356928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:30.357195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:30.357917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:30.358220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:30.360363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:30.369686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c41f-a633-4128-b08e-2baab3cadced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0126c41f-a633-4128-b08e-2baab3cadced None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:30.382068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:30.383086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:30.383874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:30.387132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 274/542] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:30.395482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c41f-a633-4128-b08e-2baab3cadced None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:30.399084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 269/543] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:30.407840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:30.507176 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:30.514054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c41f-a633-4128-b08e-2baab3cadced None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:30.576284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:30.577555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:30.577950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:30.579226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:30.580928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:30.581553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:30.584753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:30.607808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 275/544] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:30.609512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:30.683754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3667d-164b-4dc4-b572-8513e5435712 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:30.787476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:30.788409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:30.788999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:30.789530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:30.790535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=6b24f12951bd4220afad25f23f566f6d) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:30.791069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:30.792912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:30.813107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 270/545] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:30 2022] GET /identity/v3/role_assignments?user.id=6b24f12951bd4220afad25f23f566f6d&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 259 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:30.853543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f0e6-840c-435d-9204-9948d467c667 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:30.908518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1489cbf-7924-4b37-a125-6cb94a0009e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:30.909471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1489cbf-7924-4b37-a125-6cb94a0009e8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:30.909956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1489cbf-7924-4b37-a125-6cb94a0009e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:30.910359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1489cbf-7924-4b37-a125-6cb94a0009e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:30.942412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1489cbf-7924-4b37-a125-6cb94a0009e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:30.944527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1489cbf-7924-4b37-a125-6cb94a0009e8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-f1489cbf-7924-4b37-a125-6cb94a0009e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:30.981618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:30.982787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:30.983685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:30.983685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:30.983685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:30.990272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 276/546] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:30.999779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:31.092492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:31.390515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e75d-cfa5-4f15-bf1c-b9441b2c43ce None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:31.394156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9253f5-58e4-4a6f-a8c4-f70a6c030d0d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:31.394826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9253f5-58e4-4a6f-a8c4-f70a6c030d0d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:31.394980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9253f5-58e4-4a6f-a8c4-f70a6c030d0d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:31.397835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 277/547] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:31.407822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d702-c73e-4390-9005-56674c41ad7f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:31.409513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d702-c73e-4390-9005-56674c41ad7f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:31.410505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d702-c73e-4390-9005-56674c41ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:31.486722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-94e5d702-c73e-4390-9005-56674c41ad7f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:31.489615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-94e5d702-c73e-4390-9005-56674c41ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:31.501178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:31.614412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:31.614412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:31.614412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:31.614412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:31.615025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:31.615025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:31.620490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:31.665236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 271/548] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 666 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:31.700612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:31.828860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 278/549] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:31.842413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71290f79-846a-4148-a608-90f4202848ee None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:31.842413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71290f79-846a-4148-a608-90f4202848ee None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:31.842413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71290f79-846a-4148-a608-90f4202848ee None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:31.852848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 279/550] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:31 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:31.874411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47aab0-f8f7-46ec-90df-7c619a540087 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:31.874411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47aab0-f8f7-46ec-90df-7c619a540087 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:31.874411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47aab0-f8f7-46ec-90df-7c619a540087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:31.930445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9a47aab0-f8f7-46ec-90df-7c619a540087 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:31.933328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9a47aab0-f8f7-46ec-90df-7c619a540087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:32.189381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:32.312920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5e78f-7a2d-42b5-9c30-c514e50aa336 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:32.400543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 280/551] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:32.403289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47aab0-f8f7-46ec-90df-7c619a540087 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:32.496292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98f827-6e91-4463-8832-812ef6acb6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:32.497245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f827-6e91-4463-8832-812ef6acb6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:32.497904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f827-6e91-4463-8832-812ef6acb6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:32.498728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f827-6e91-4463-8832-812ef6acb6b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:32.515730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98f827-6e91-4463-8832-812ef6acb6b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:32.520994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98f827-6e91-4463-8832-812ef6acb6b7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-db98f827-6e91-4463-8832-812ef6acb6b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:32.592630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:32.594477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:30:32.596203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:32.604371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 272/552] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:30:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 907 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:32.607535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efabd2b-81e9-4fe9-84da-c7fe9a2caed5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:32.608256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efabd2b-81e9-4fe9-84da-c7fe9a2caed5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:32.608928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efabd2b-81e9-4fe9-84da-c7fe9a2caed5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:32.613859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 273/553] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:32.615825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efabd2b-81e9-4fe9-84da-c7fe9a2caed5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:32.709496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:32.790162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47aab0-f8f7-46ec-90df-7c619a540087 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:32.840204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566968a8-d085-4eff-9fd1-39fa2b7a4111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:32.841031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566968a8-d085-4eff-9fd1-39fa2b7a4111 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:32.841827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566968a8-d085-4eff-9fd1-39fa2b7a4111 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:32.842676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566968a8-d085-4eff-9fd1-39fa2b7a4111 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:32.864752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566968a8-d085-4eff-9fd1-39fa2b7a4111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-566968a8-d085-4eff-9fd1-39fa2b7a4111 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:32.874188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:32.876043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:32.877679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:32.880493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 281/554] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:32.882575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce32d74-aa75-49f9-b0ed-f03c81de6249 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:32.882969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce32d74-aa75-49f9-b0ed-f03c81de6249 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:32.883335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce32d74-aa75-49f9-b0ed-f03c81de6249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:32.918503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3ce32d74-aa75-49f9-b0ed-f03c81de6249 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:32.920732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3ce32d74-aa75-49f9-b0ed-f03c81de6249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:32.988653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efabd2b-81e9-4fe9-84da-c7fe9a2caed5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:33.086980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:33.087988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:33.088440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:33.088892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:33.090252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:33.090823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:33.093603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:33.122113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:33.129575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 282/555] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:33.131380 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce32d74-aa75-49f9-b0ed-f03c81de6249 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:33.133313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 274/556] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Aug 30 14:30:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:33.135154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:33.319973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:33.429750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce32d74-aa75-49f9-b0ed-f03c81de6249 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:33.437780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e102634-e3e0-4d66-affc-0d8e2200f069 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:33.501396 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:33.502744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f0437-df0b-4c1b-a0fd-e79350c13b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:33.503932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:33.504681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:33.505408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:33.506898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:33.507702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:33.508878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f0437-df0b-4c1b-a0fd-e79350c13b94 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:33.509976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f0437-df0b-4c1b-a0fd-e79350c13b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:33.510761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f0437-df0b-4c1b-a0fd-e79350c13b94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:33.511431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:33.528247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 275/557] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:33.530270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:33.542265 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f0437-df0b-4c1b-a0fd-e79350c13b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-846f0437-df0b-4c1b-a0fd-e79350c13b94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:33.553327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:33.555071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 283/558] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:33.557693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f0437-df0b-4c1b-a0fd-e79350c13b94 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:33.652749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:33.710551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0336ad-9b14-44cc-aad1-2331049b6f8b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:33.763958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c427c-0259-4d43-9480-fdcdcf01362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:33.765002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c427c-0259-4d43-9480-fdcdcf01362e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:33.765471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c427c-0259-4d43-9480-fdcdcf01362e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:33.766213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c427c-0259-4d43-9480-fdcdcf01362e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:33.766777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f0437-df0b-4c1b-a0fd-e79350c13b94 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:33.795003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:33.816747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:33.817791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:33.818196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:33.818639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:33.833232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:33.835273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:33.851746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:33.854101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:33.855990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:33.855990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:33.855990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:33.855990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 284/559] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:33.855990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:33.898689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c427c-0259-4d43-9480-fdcdcf01362e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:33.900389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c427c-0259-4d43-9480-fdcdcf01362e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:33.993900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:34.023722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc98002-6b95-4b53-bb92-d6b00f4a72a7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:34.057139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 276/560] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:34.059199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c427c-0259-4d43-9480-fdcdcf01362e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:34.076654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:34.077641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.077936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.078199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.080312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:34.080312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:34.080896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:34.091725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 285/561] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:34.092599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:34.144238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:34.207076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c427c-0259-4d43-9480-fdcdcf01362e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:34.242664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96859f-1e17-48ee-98f0-8a113c9a68fe None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:34.260345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb3b1-57c5-464d-a269-74ebfcddf54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:34.261227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb3b1-57c5-464d-a269-74ebfcddf54e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.261637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb3b1-57c5-464d-a269-74ebfcddf54e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.262064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb3b1-57c5-464d-a269-74ebfcddf54e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.279065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eb3b1-57c5-464d-a269-74ebfcddf54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-522eb3b1-57c5-464d-a269-74ebfcddf54e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:34.287553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:34.288767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:34.290233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 277/562] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:34.292404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb3b1-57c5-464d-a269-74ebfcddf54e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:34.301755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfa46c-9a30-4c51-a4e0-5b55891b34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:34.302627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa46c-9a30-4c51-a4e0-5b55891b34bd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.303025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa46c-9a30-4c51-a4e0-5b55891b34bd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.303403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa46c-9a30-4c51-a4e0-5b55891b34bd None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.304170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfa46c-9a30-4c51-a4e0-5b55891b34bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:34.304614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfa46c-9a30-4c51-a4e0-5b55891b34bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:34.306586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfa46c-9a30-4c51-a4e0-5b55891b34bd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:34.323037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 286/563] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:34.325101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801444-e557-43f7-973b-2d5ebe51472d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.325534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801444-e557-43f7-973b-2d5ebe51472d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.326090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801444-e557-43f7-973b-2d5ebe51472d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.327941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:34.330649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 287/564] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:34.332051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d801444-e557-43f7-973b-2d5ebe51472d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:34.430708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb3b1-57c5-464d-a269-74ebfcddf54e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:34.469563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:34.470202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.470520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.470793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.476031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:34.484407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:34.486314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d801444-e557-43f7-973b-2d5ebe51472d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:34.487226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:34.516911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:34.518533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:34.519597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:34.519597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:34.519597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:34.520517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 278/565] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:34.521984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:34.527917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:34.528855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.529283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.529708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.541526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:34.543183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:34.559355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:34.560726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:34.562297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:34.562297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:34.562297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:34.562297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 288/566] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:34.562297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:34.637004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:34.669987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5ae14-6da8-4ed1-a1b6-b331a9af613e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:34.690941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4197b-6e01-4ca9-90a5-900148a0a868 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:34.711006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a02775-603e-48ac-839d-47ac86b3a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:34.711948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02775-603e-48ac-839d-47ac86b3a16f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.712424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02775-603e-48ac-839d-47ac86b3a16f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.712863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02775-603e-48ac-839d-47ac86b3a16f None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.713636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02775-603e-48ac-839d-47ac86b3a16f None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:34.714052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02775-603e-48ac-839d-47ac86b3a16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:34.716454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02775-603e-48ac-839d-47ac86b3a16f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:34.729895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 279/567] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:34.731957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698d39-90af-4699-9abd-a6a91aeecb43 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.732400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698d39-90af-4699-9abd-a6a91aeecb43 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.732834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698d39-90af-4699-9abd-a6a91aeecb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.747547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:34.748530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:34.748962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:34.749391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:34.759058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9d698d39-90af-4699-9abd-a6a91aeecb43 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:34.760861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9d698d39-90af-4699-9abd-a6a91aeecb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:34.761948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:34.764436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:34.783556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:34.785517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:30:34.786660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:34.790663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 289/568] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:34.792098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:34.805566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:34.861897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 280/569] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:34.863046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d698d39-90af-4699-9abd-a6a91aeecb43 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:34.946124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60076108-0bd3-462d-aa02-8ae6f69bcbbd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:34.969926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:35.010773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:35.011688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:35.012113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:35.012534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:35.013700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:35.014181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:35.016526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:35.024144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d698d39-90af-4699-9abd-a6a91aeecb43 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:35.036013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 290/570] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:35.037419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:35.090901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:35.091869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:35.092335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:35.092800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:35.093916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:35.094471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:35.096966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:35.122253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 281/571] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:35.122253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:35.150171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:35.209527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e475f-b5ca-4926-8241-3dd6367b9ca4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:35.250831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda64ea7-d090-4fc0-bfee-c6df5d4d8e05 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:35.269989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:35.270809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:35.271157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:35.271493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:35.286552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:35.287438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:35.288438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:35.305681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:35.306585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:35.307515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:35.307515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:35.308705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:35.309009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:35.310565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:35.313159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:35.315207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:35.316995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:35.316995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:35.316995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:35.316995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 291/572] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:35.320277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:35.347057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 282/573] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Aug 30 14:30:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:35.348207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:35.489810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8161-d4e9-4a7e-bfcb-3f59ca74a348 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:35.511519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f2725-621d-49e1-83c1-2a2593b8ecab None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:35.537894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:35.538484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:35.538940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:35.539387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:35.539944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:35.548455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:35.550162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:35.569745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:35.572355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:30:35.574554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:35.575617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:35.575617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:35.575891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 283/574] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:35.576029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:35.576029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:35.576261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:35.590282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:35.592917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:35.611435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:35.612521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:35.613764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 292/575] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:35.615052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:35.663609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:35.747949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6285119-3b57-4e07-a9cc-7143facd1767 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:35.751962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28746b1-ca37-4b7d-8128-4175b7e07ccf None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:35.793313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:35.794109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:35.794583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:35.794964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:35.796037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:35.796426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:35.798835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:35.808231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4e21-2a1d-49d7-9fc6-19104383a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:35.809217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4e21-2a1d-49d7-9fc6-19104383a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:35.809643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4e21-2a1d-49d7-9fc6-19104383a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:35.810065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4e21-2a1d-49d7-9fc6-19104383a2d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:35.821106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 293/576] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:35.825932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c4e21-2a1d-49d7-9fc6-19104383a2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:35.829729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-777c4e21-2a1d-49d7-9fc6-19104383a2d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:35.831646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:35.833620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:35.835646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:35.837971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 284/577] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:35.838992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4e21-2a1d-49d7-9fc6-19104383a2d0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:35.884704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:35.963937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4e21-2a1d-49d7-9fc6-19104383a2d0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:35.967481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:35.978733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e73c1-e877-438c-a1a0-e7ee45fc3b8f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.005693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.006679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.007065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.007441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.008370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:36.008778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.010416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.024519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.026030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.026318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.026627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.033130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 285/578] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Aug 30 14:30:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:36.035060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.039155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.042435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:36.058658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:36.059811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:36.060884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:36.060884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:36.060884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:36.060884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 294/579] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:36.060884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.165037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:36.182108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea0849-7c27-447f-a2d8-2b764fe30c15 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.196330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de2a6e-beed-4dfb-8c22-425e9cca7ac8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.234810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.235604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.236006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.236365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.237066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:36.237363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.238845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.242032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.242922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.243284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.243815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.254752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.255550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 286/580] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:36.256362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.256629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:36.274583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:36.276710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 295/581] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:36.278556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.298414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:36.391611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761444b0-a947-4e2d-b921-c462d065b85e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.435091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.435742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.436020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.436298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.436991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:36.437300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.438754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.448867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 287/582] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:36.449867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.466417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722c1fc-e5b2-495d-a1e8-70244bcffd68 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.532305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.533337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.533337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.533692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.547609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.549695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.567894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:36.568700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:36.570575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:36.572403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:36.572403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:36.572403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:36.572403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 296/583] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:36.572403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.577829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:36.602460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbb408-459f-4525-885e-0ed1d456c980 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.658357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.658925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.659200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.659479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.660123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:36.660417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.661827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.677411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 288/584] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:36.678733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.711997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fb260-2ebd-432b-b36a-657c0dd8b7c0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.758206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.759037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.759671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.759671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.761102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=b4639f179d4b4bb7b1fae6a8cf28d919) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:36.761553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.763701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.771159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 297/585] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/role_assignments?user.id=b4639f179d4b4bb7b1fae6a8cf28d919&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:36.772683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.849524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55375a-4d1d-4c99-8ac9-9ee025329efb None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.874740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:36.927198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.928101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.928541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.928962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.929725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133f0b-51e1-4a52-b098-a3d7acaae151 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:36.930215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:36.930729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:36.935285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:36.977500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:36.979118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:36.979388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:36.979822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:36.985189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 289/586] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:36.987313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:36.992093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:37.001558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:37.004312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:37.036345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:37.038153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:37.040540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:37.040540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:37.040540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:37.040540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 298/587] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:37.040540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:37.176714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96ea58-a5bd-44cc-b672-b9a295d1cebd None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:37.222827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552677-50d4-492e-a197-1d5ff519bbd6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:37.236793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:37.237615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:37.238036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:37.238481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:37.239575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:37.240049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:37.242290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:37.263404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 290/588] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:37.265261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:37.268176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:37.300172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:37.301081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:37.301691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:37.301965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:37.314199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:37.316716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:37.336192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:37.338165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:37.340463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:37.340463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:37.340463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:37.340463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:37.340463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:37.340463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:37.340463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:37.340463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:37.344637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 299/589] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:37.345568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:37.384819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:37.470238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624914f3-b27d-41d0-85fb-bc3a0429bc38 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:37.509571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342d6a5-626c-4061-afe3-629c6275ded0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:37.546490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:37.547546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:37.548015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:37.548480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:37.560400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:37.561808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:37.562275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:37.562770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:37.563614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:37.564245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:37.565815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:37.567983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:37.570739 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:37.590298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 300/590] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:37.592597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:37.599131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:37.600868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:37.603101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:37.603101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:37.603101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:37.603101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 291/591] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:37.603101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:37.674812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:37.753359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441365aa-3770-44e2-a365-d07f0a36fc2d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:37.771091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aed274-06ea-4212-b82b-9d7ed479cdeb None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:37.779601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:37.821312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:37.822350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:37.822842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:37.823303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:37.824573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:37.825102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:37.828188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:37.831706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:37.833033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:37.833219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:37.833656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:37.846834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:37.849543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:37.856850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 292/592] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:37.856850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:37.870483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:37.871467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:37.872351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 301/593] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:37.874060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:38.053027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a99f9-c612-4f4b-ba21-7cfc4f2e96c7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:38.058754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:38.065000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51b2c6-a7f7-40d7-8a0e-69ab7b5c13c6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:38.112808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:38.114949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:38.114949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:38.114949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:38.130552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:38.131501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:38.131834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:38.132171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:38.132572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:38.132953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:38.133318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:38.134989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:38.136391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:38.149659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 302/594] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:38.150371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:38.168441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:38.170257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 293/595] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:38.172446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:38.234067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:38.325008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d236-e52f-493e-b72b-1863e7cf827c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:38.358560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0b13-6b4a-4beb-b152-4d1d34e0fa7a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:38.385511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64718d-13cc-4000-b1ac-f9dd021baa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:38.386415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64718d-13cc-4000-b1ac-f9dd021baa9e None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:38.386709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64718d-13cc-4000-b1ac-f9dd021baa9e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:38.387471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64718d-13cc-4000-b1ac-f9dd021baa9e None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/a725ee4d8b0b4524ad8484c3255f75da/roles/b02fcaf15370497abe5973b37a3a2a74` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:38.408061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64718d-13cc-4000-b1ac-f9dd021baa9e None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=a725ee4d8b0b4524ad8484c3255f75da, role_id=b02fcaf15370497abe5973b37a3a2a74)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:38.410699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64718d-13cc-4000-b1ac-f9dd021baa9e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:38.430667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 303/596] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:30:38 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/a725ee4d8b0b4524ad8484c3255f75da/roles/b02fcaf15370497abe5973b37a3a2a74 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:38.432085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64718d-13cc-4000-b1ac-f9dd021baa9e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:38.444365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:38.451458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:38.452774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:38.453503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:38.454731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:38.455479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:38.456281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:38.459510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:38.492525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 294/597] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:38.494709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:38.619812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64718d-13cc-4000-b1ac-f9dd021baa9e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:38.695723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:38.696152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:38.696152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:38.696419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:38.698244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:38.705945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:38.707679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:38.716561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2a5a5-0297-48d9-bd49-bfd1ab8c7c18 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:38.723131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:38.724853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:38.726613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:38.726613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:38.726613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:38.726613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:38.726613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:38.726613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:38.726613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:38.726613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:38.730282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 304/598] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:38.731368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:38.773186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:38.773817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:38.774097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:38.774392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:38.775574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:38.776143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:38.777746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:38.808331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 295/599] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Aug 30 14:30:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:38.809154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:38.863834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:38.919489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f309f2-00e8-401f-85e6-2f5713eff708 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:38.965425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1901c2-8255-427c-863a-fc803378ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:38.966126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1901c2-8255-427c-863a-fc803378ac21 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:38.966434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1901c2-8255-427c-863a-fc803378ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:38.966714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1901c2-8255-427c-863a-fc803378ac21 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/89357dc69c8f456580613061f2cbef07/roles/b02fcaf15370497abe5973b37a3a2a74` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:38.986185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1901c2-8255-427c-863a-fc803378ac21 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=89357dc69c8f456580613061f2cbef07, role_id=b02fcaf15370497abe5973b37a3a2a74)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:38.987757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1901c2-8255-427c-863a-fc803378ac21 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:39.012191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 305/600] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:30:38 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/89357dc69c8f456580613061f2cbef07/roles/b02fcaf15370497abe5973b37a3a2a74 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:39.018239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1901c2-8255-427c-863a-fc803378ac21 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:39.066148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1b1ee-d8da-4454-bfb0-c8089502d140 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:39.152493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:39.154995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:39.155939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:39.156835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:39.158220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:39.159198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:39.162085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:39.191476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 296/601] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:39.199534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:39.231859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:39.305632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1901c2-8255-427c-863a-fc803378ac21 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:39.333972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:39.365304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:39.370531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:39.371488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:39.372132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:39.397570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:39.401428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:39.412871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7e1b-1ace-43e2-b36c-41043df6091d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:39.436580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:39.438609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:39.440578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:39.440578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:39.440578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:39.443739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 306/602] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:39.450077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:39.474418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12268d-74ef-4200-9ec3-f48076110545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:39.474418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12268d-74ef-4200-9ec3-f48076110545 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:39.474418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12268d-74ef-4200-9ec3-f48076110545 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:39.474418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12268d-74ef-4200-9ec3-f48076110545 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/906464ed50294dc481c4d1d570a5195b/roles/b02fcaf15370497abe5973b37a3a2a74` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:39.510707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12268d-74ef-4200-9ec3-f48076110545 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=906464ed50294dc481c4d1d570a5195b, role_id=b02fcaf15370497abe5973b37a3a2a74)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:39.512676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12268d-74ef-4200-9ec3-f48076110545 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:39.548585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 297/603] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:30:39 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/906464ed50294dc481c4d1d570a5195b/roles/b02fcaf15370497abe5973b37a3a2a74 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:39.584555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf38cb-85b2-4b09-b30d-f2910f79919e None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:39.584950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf38cb-85b2-4b09-b30d-f2910f79919e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:39.585157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf38cb-85b2-4b09-b30d-f2910f79919e None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:39.587223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 298/604] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:39.593682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f48438-27a8-4175-ab88-0baecc79179f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:39.594058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f48438-27a8-4175-ab88-0baecc79179f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:39.594232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f48438-27a8-4175-ab88-0baecc79179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:39.643267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a0f48438-27a8-4175-ab88-0baecc79179f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:39.649239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a0f48438-27a8-4175-ab88-0baecc79179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:39.709932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d8ed1-eeac-4f0b-aa4a-d763e5f15aab None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:39.764566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:39.766296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:39.767441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:39.768371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:39.769415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:39.769948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:39.772826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:39.796050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 307/605] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:39.805893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:39.823467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:39.834937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 299/606] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:39.858084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:39.957086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7131920-b70d-4fe5-8a44-6563a11f42af None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:39.999645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:40.000224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:40.000506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:40.000816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:40.011215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:40.012748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:40.027709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:40.028657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:40.029521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 308/607] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:40.036703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f48438-27a8-4175-ab88-0baecc79179f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:40.129556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:40.185483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f48438-27a8-4175-ab88-0baecc79179f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:40.234978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:40.234978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:40.234978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:40.234978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:40.235415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:40.235415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:40.237751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:40.253838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 300/608] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:40.263620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:40.377892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:40.400011 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:40.416636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe89e-bcd9-4433-ace7-82404f51e1d4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:40.496677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413cb9a-3177-4c64-b650-bacc4324b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:40.499580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413cb9a-3177-4c64-b650-bacc4324b8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:40.500111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413cb9a-3177-4c64-b650-bacc4324b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:40.500586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413cb9a-3177-4c64-b650-bacc4324b8b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:40.512379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c7f19-22a6-4715-ad40-8c00ba98d897 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:40.531436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413cb9a-3177-4c64-b650-bacc4324b8b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9413cb9a-3177-4c64-b650-bacc4324b8b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:40.536853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:40.537811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:40.538678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:40.551417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 309/609] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:40.552767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413cb9a-3177-4c64-b650-bacc4324b8b3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:40.599121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06840312-077b-4701-a675-14558ed0e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:40.602260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06840312-077b-4701-a675-14558ed0e9dc None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:40.602885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06840312-077b-4701-a675-14558ed0e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:40.604507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06840312-077b-4701-a675-14558ed0e9dc None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/6b24f12951bd4220afad25f23f566f6d/roles/b02fcaf15370497abe5973b37a3a2a74` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:40.631529 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06840312-077b-4701-a675-14558ed0e9dc None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=6b24f12951bd4220afad25f23f566f6d, role_id=b02fcaf15370497abe5973b37a3a2a74)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:40.635607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06840312-077b-4701-a675-14558ed0e9dc None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:40.665159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 301/610] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:30:40 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/6b24f12951bd4220afad25f23f566f6d/roles/b02fcaf15370497abe5973b37a3a2a74 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:40.718410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e950-2062-4710-b733-91d4d61ed234 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:40.718410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e950-2062-4710-b733-91d4d61ed234 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:40.718410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31e950-2062-4710-b733-91d4d61ed234 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:40.718744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 302/611] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:40.722214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f652a88-97c0-49b7-8128-2daf972d62ef None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:40.722910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f652a88-97c0-49b7-8128-2daf972d62ef None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:40.723193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f652a88-97c0-49b7-8128-2daf972d62ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:40.760518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2f652a88-97c0-49b7-8128-2daf972d62ef None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:40.761819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2f652a88-97c0-49b7-8128-2daf972d62ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:40.782521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413cb9a-3177-4c64-b650-bacc4324b8b3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:40.882902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:40.882902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:40.882902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:40.882902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:40.883408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:40.883408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:40.885373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:40.914294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 310/612] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:40.919692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:40.933057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 303/613] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:40.961142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:41.038552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d522346-9a8b-4614-9077-d61e949f6c69 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:41.077174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:41.078100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:41.078573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:41.079001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:41.091714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:41.093631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:41.110761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:41.111884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:41.112767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:41.112767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:41.112767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:41.114671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 311/614] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:41.120711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f652a88-97c0-49b7-8128-2daf972d62ef None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:41.176923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:41.266531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:41.338723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f652a88-97c0-49b7-8128-2daf972d62ef None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:41.399024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:41.421819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:41.422497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:41.422785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:41.423057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:41.423713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:41.424013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:41.426344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:41.447782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 304/615] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:41.468573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:41.501297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77484-205c-4b4c-a728-adc549c811ad None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:41.580004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846a4a8-1d56-445e-b4c1-92d511c247ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:41.580672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846a4a8-1d56-445e-b4c1-92d511c247ee None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:41.580951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846a4a8-1d56-445e-b4c1-92d511c247ee None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:41.581224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846a4a8-1d56-445e-b4c1-92d511c247ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:41.605376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846a4a8-1d56-445e-b4c1-92d511c247ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-1846a4a8-1d56-445e-b4c1-92d511c247ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:41.617122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:41.618200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:41.619635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:41.622631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 312/616] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:41.629842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846a4a8-1d56-445e-b4c1-92d511c247ee None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:41.681541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:41.698880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a1a3e-7179-4c76-8f37-108aa453bb1e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:41.773425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:41.776249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:41.776989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:41.778398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:41.795617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:41.801270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:41.827751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:41.828763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:30:41.829696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:41.836685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 305/617] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:30:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:41.843166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:41.896322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846a4a8-1d56-445e-b4c1-92d511c247ee None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:41.961312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:41.986828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:41.988335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:41.989011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:41.989913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:41.991757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:41.992766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:41.996090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:42.022407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 313/618] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:42.036083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:42.060966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4523d5-cbff-4ee9-980e-a942c5459204 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:42.105160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:42.106259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.106767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.107243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.109298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:42.110950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:42.115104 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:42.157100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 306/619] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Aug 30 14:30:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:42.163012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:42.184840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:42.297716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7de256-b79e-437b-a242-fda3690e30d7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:42.348571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:42.349605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.350206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.350702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.365118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:42.367216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:42.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:42.388143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:42.389016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:42.389016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:42.389016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:42.396407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 314/620] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:42.398994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:42.458652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:42.508700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab6f5-b5ae-4518-8b5f-24b3750b58bf None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:42.543172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e212-facc-47e5-b465-5b15037c6559 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:42.611842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:42.612788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:42.613637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.614445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.614876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.615319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.616415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.616855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.617894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:42.619839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:42.621493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:42.642884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:42.647531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:42.665449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 315/621] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:42.676400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:42.677595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:42.678725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:42.678725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:42.678725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:42.680100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:42.688287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 307/622] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:42.695244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:42.810243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:42.824594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:42.831070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7d38e-e1f1-44da-b2cc-56d43fdfd8b4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:42.864091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aff42b-18ae-4a01-b16b-5e4df6fb7936 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:42.883693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7a480-286e-4737-b843-5624ed5595f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:42.885175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a480-286e-4737-b843-5624ed5595f8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.886137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a480-286e-4737-b843-5624ed5595f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.886457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a480-286e-4737-b843-5624ed5595f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.895753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7a480-286e-4737-b843-5624ed5595f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:42.897286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7a480-286e-4737-b843-5624ed5595f8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-04b7a480-286e-4737-b843-5624ed5595f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:42.912088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:42.913133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:30:42.919707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:42.920265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:42.920265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.920415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 316/623] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:42.920483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.920483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.920615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b64ae-2351-4fa2-a4bc-5a7d7c606ca4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.920615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b64ae-2351-4fa2-a4bc-5a7d7c606ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.920615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b64ae-2351-4fa2-a4bc-5a7d7c606ca4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.920788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:42.920788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:42.920788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:42.922004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 317/624] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:42.923081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc48be0-6516-4e9c-814d-160518ce9c6c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.923366 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc48be0-6516-4e9c-814d-160518ce9c6c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.923674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc48be0-6516-4e9c-814d-160518ce9c6c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.924944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 318/625] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:42.926011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0e5f8-e7bf-48cb-a145-9059d6acda86 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:42.926288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0e5f8-e7bf-48cb-a145-9059d6acda86 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:42.926674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0e5f8-e7bf-48cb-a145-9059d6acda86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:42.942838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 308/626] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:42.944751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:42.952560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0de0e5f8-e7bf-48cb-a145-9059d6acda86 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:42.954042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0de0e5f8-e7bf-48cb-a145-9059d6acda86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:43.058423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 319/627] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:43.058423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05845ff-881c-43ab-8361-603052f79834 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:43.058423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05845ff-881c-43ab-8361-603052f79834 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:43.058423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05845ff-881c-43ab-8361-603052f79834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:43.080965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b05845ff-881c-43ab-8361-603052f79834 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:43.083167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b05845ff-881c-43ab-8361-603052f79834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:43.148021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f64091-64f4-499d-a618-a94f6f228b5f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:43.191548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:43.237394 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852bdfc-9a1d-411a-823a-715c9c760f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:43.237776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852bdfc-9a1d-411a-823a-715c9c760f45 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:43.238206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852bdfc-9a1d-411a-823a-715c9c760f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:43.238676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852bdfc-9a1d-411a-823a-715c9c760f45 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:43.239587 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852bdfc-9a1d-411a-823a-715c9c760f45 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:43.239958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852bdfc-9a1d-411a-823a-715c9c760f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:43.241635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852bdfc-9a1d-411a-823a-715c9c760f45 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:43.252182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 320/628] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:43.252182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05845ff-881c-43ab-8361-603052f79834 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:43.282491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 309/629] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Aug 30 14:30:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:43.284028 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0008-1cec-4bc5-a7e5-5f097228f1f9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:43.284318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0008-1cec-4bc5-a7e5-5f097228f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:43.284470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:43.284606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0008-1cec-4bc5-a7e5-5f097228f1f9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:43.285957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 310/630] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:43.290566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0008-1cec-4bc5-a7e5-5f097228f1f9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:43.439659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0008-1cec-4bc5-a7e5-5f097228f1f9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:43.442734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05845ff-881c-43ab-8361-603052f79834 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:43.492733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6a4ac-9b3b-4f01-a085-58db8c07d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:43.494209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6a4ac-9b3b-4f01-a085-58db8c07d134 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:43.495311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6a4ac-9b3b-4f01-a085-58db8c07d134 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:43.495832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6a4ac-9b3b-4f01-a085-58db8c07d134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:43.511849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e7be-d967-47df-8bca-29f0946ccfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:43.512960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e7be-d967-47df-8bca-29f0946ccfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:43.513442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e7be-d967-47df-8bca-29f0946ccfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:43.513940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e7be-d967-47df-8bca-29f0946ccfd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:43.531168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e7be-d967-47df-8bca-29f0946ccfd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:43.534115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e7be-d967-47df-8bca-29f0946ccfd0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4e42e7be-d967-47df-8bca-29f0946ccfd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:43.561295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:43.563020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:43.565473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:43.565473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:43.565473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:43.565473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:43.565473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:43.565473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:43.565473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:43.565473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:43.569493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 321/631] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:43.572358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81888a-d37d-408d-80a2-a3119b6f904b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:43.572812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81888a-d37d-408d-80a2-a3119b6f904b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:43.573270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81888a-d37d-408d-80a2-a3119b6f904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:43.574902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:43.595235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4f81888a-d37d-408d-80a2-a3119b6f904b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:43.596504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4f81888a-d37d-408d-80a2-a3119b6f904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:43.598760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6a4ac-9b3b-4f01-a085-58db8c07d134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:43.600281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6a4ac-9b3b-4f01-a085-58db8c07d134 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:43.675695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 322/632] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:43.676995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81888a-d37d-408d-80a2-a3119b6f904b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:43.699141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:43.760251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 311/633] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:43.760251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6a4ac-9b3b-4f01-a085-58db8c07d134 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:43.853799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81888a-d37d-408d-80a2-a3119b6f904b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:43.904369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f9433-d11e-4424-b6ed-01177916d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:43.905300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f9433-d11e-4424-b6ed-01177916d009 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:43.905300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f9433-d11e-4424-b6ed-01177916d009 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:43.905586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f9433-d11e-4424-b6ed-01177916d009 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:43.907150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:43.918526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f9433-d11e-4424-b6ed-01177916d009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ac6f9433-d11e-4424-b6ed-01177916d009 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:43.923409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:43.925227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:43.926748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:43.929686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 323/634] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:43.930953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f9433-d11e-4424-b6ed-01177916d009 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:43.955061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6a4ac-9b3b-4f01-a085-58db8c07d134 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.005229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b7f8-b46c-45e4-a4ce-08a23f8a2f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.006032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b7f8-b46c-45e4-a4ce-08a23f8a2f9f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.006355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b7f8-b46c-45e4-a4ce-08a23f8a2f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.006727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b7f8-b46c-45e4-a4ce-08a23f8a2f9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.018761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b7f8-b46c-45e4-a4ce-08a23f8a2f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f843b7f8-b46c-45e4-a4ce-08a23f8a2f9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:44.023808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:44.025754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 312/635] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:44.027386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b7f8-b46c-45e4-a4ce-08a23f8a2f9f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.029776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:44.080284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f9433-d11e-4424-b6ed-01177916d009 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.122370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.123321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.123718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.124075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.124910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:44.125299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:44.127184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:44.143089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 324/636] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:44.144001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.185044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b7f8-b46c-45e4-a4ce-08a23f8a2f9f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.236801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.237379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.237654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.237926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.249865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:44.253537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:44.256589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:44.277846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f163d2-de8c-4219-9251-61c1e57e0cd0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:44.280324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:44.282034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:44.284017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:44.284017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:44.284017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:44.284017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 313/637] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:44.284017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.318274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:44.331709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.332737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.333198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.333577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.334368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:44.334747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:44.336638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:44.356773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 325/638] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:44.356773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.416356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da11791-193c-48d1-bd32-9cbacb7b8252 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.468599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b00fe0-0666-478e-8c64-b15394683efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.469249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00fe0-0666-478e-8c64-b15394683efe None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.469528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00fe0-0666-478e-8c64-b15394683efe None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.469796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00fe0-0666-478e-8c64-b15394683efe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.482447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b00fe0-0666-478e-8c64-b15394683efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-67b00fe0-0666-478e-8c64-b15394683efe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:44.488061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:44.489195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:44.490029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:44.494581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 314/639] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:44.494992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e64f-eeab-4722-9286-203cc1fa79a5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.495963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b00fe0-0666-478e-8c64-b15394683efe None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.559988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.560827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.561183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:44.561330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.561589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.562505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:44.562770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:44.564384 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:44.574127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 326/640] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:44.575046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.620744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b00fe0-0666-478e-8c64-b15394683efe None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.639770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:44.674973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1e970-9819-4880-821b-7e388e364641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.675987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e970-9819-4880-821b-7e388e364641 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.676478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e970-9819-4880-821b-7e388e364641 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.676942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e970-9819-4880-821b-7e388e364641 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/b4639f179d4b4bb7b1fae6a8cf28d919/roles/b02fcaf15370497abe5973b37a3a2a74` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.695043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1e970-9819-4880-821b-7e388e364641 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=b4639f179d4b4bb7b1fae6a8cf28d919, role_id=b02fcaf15370497abe5973b37a3a2a74)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:44.696550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1e970-9819-4880-821b-7e388e364641 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:44.697067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fe5ed-b515-4d09-80e7-9e121e9b45d0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.712082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 315/641] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:30:44 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/b4639f179d4b4bb7b1fae6a8cf28d919/roles/b02fcaf15370497abe5973b37a3a2a74 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:30:44.713281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1e970-9819-4880-821b-7e388e364641 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.752812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.753500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.753613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.753867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.754575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:44.754878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:44.756347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:44.771870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 327/642] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:44.776215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.874904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1e970-9819-4880-821b-7e388e364641 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.877279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:44.928391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.929047 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.929326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.929605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.938928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669eaed-bc70-4ac4-9b91-af65dcc27878 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:44.949804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:44.952087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:44.956547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:44.974613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:44.976404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:44.977774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:44.977774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:44.977774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:44.977774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 316/643] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:44.977774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:44.993069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:44.993715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:44.993985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:44.994262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:44.995190 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:44.995383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:44.996773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.006972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 328/644] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:45.007766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:45.148131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128de21-f447-409a-a442-ff72c311d751 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:45.151786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ecab7-b8ff-4146-b308-d6f03d077985 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:45.209491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:45.211006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:45.211006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:45.211498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:45.222761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:45.223692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:45.224153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:45.224594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:45.231909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:45.234756 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.237454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:45.240765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:45.256795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:45.258950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:45.260943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:45.260943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:45.260943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:45.260943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:45.260943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:45.260943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:45.260943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:45.260943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:45.262200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:45.265694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:45.270785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:45.270785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:45.270785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:45.271498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 329/645] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:45.271498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:45.272018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 317/646] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:45.273517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:45.294241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:45.315193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:45.422205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19ac5-8e13-42e4-a3bc-7ea474f6045b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:45.437361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f39d7-4759-4789-870f-a716f1062a8f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:45.468179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:45.468816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:45.469089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:45.469355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:45.470124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:45.470561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:45.472017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.476706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:45.477354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:45.477673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:45.477937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:45.487502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 330/647] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:45.488742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:45.508651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:45.510766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:45.527332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:45.528900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:45.530687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:45.530687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:45.530687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:45.530687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 318/648] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:45.530687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:45.602809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:45.669496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dc07c-2cfe-4622-ad2b-b53b85f2661f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:45.671192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:45.683269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8b004-b778-4d93-9262-115eceeb3432 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:45.717149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:45.718136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:45.718533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:45.718914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:45.719806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:45.720113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:45.722512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.729405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:45.730041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:45.730321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:45.730608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:45.731332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:45.731632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:45.733117 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.744711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 319/649] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:45.745592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:45.748252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 331/650] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:45.749322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:45.882961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3f0b6-cd79-48f5-be34-f6867ea71cb9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:45.894029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a48cc-cccc-4a7f-aad7-0b76b1657bb5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:45.912017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:45.939807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:45.941178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:45.941464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:45.941973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:45.942603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:45.942934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:45.944348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.950980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:45.952424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:45.953138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:45.953579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:45.963081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 332/651] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:45.964916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:45.970080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:45.971764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:45.985256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:45.994147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:45.995222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 14:30:45.996144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:46.002250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 320/652] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:46.003481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:46.108017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9508d-20ab-48c3-8e08-5d621df40da9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:46.127770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1910-c2d4-43dc-86bc-f62d171abcd7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:46.152420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:46.152676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:46.152808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:46.154111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:46.166292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:46.167985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:46.177464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:46.178093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:46.178367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:46.178668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:46.179469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=a725ee4d8b0b4524ad8484c3255f75da) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:46.179757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:46.181473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:46.182268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:46.184288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 333/653] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:30:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:46.187939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:46.197134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 321/654] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:46 2022] GET /identity/v3/role_assignments?user.id=a725ee4d8b0b4524ad8484c3255f75da&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:46.204235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:46.263610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:46.337681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:46.341329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc268f5-15ef-4f78-aea3-989af8a72303 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:46.388568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:46.389399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:46.389772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:46.390139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:46.391103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:46.391521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:46.391896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5362a-215c-466f-8538-540acfe9c6f1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:46.393646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:46.419048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 322/655] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Aug 30 14:30:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:46.420228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:46.465817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:46.467225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:46.467925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:46.468525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:46.483489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:46.486828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:46.512185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:46.514067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 14:30:46.515972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:46.517870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 334/656] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:46.519000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:46.578920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13664d-537d-4a1c-b12a-fa3586ea5c2b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:46.582923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:46.648034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:46.650536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:46.651567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:46.652498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:46.654173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:46.655031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:46.658200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:46.688475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27668a01-2115-4ba8-b2dc-d725a6e0fdda None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:46.691336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 323/657] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:30:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:46.692535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:46.752752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933238a-b2eb-4e3f-976a-b4f26c1fd5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:46.753589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933238a-b2eb-4e3f-976a-b4f26c1fd5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:46.753870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933238a-b2eb-4e3f-976a-b4f26c1fd5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:46.754151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933238a-b2eb-4e3f-976a-b4f26c1fd5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:46.758216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:46.823339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d9f2d-de26-43cd-8423-f074ac66848f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:46.854364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933238a-b2eb-4e3f-976a-b4f26c1fd5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:46.859949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933238a-b2eb-4e3f-976a-b4f26c1fd5c8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:46.876836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:46.877661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:46.878055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:46.878543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:46.879858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:46.880169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:46.881883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:46.915643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 324/658] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Aug 30 14:30:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:46.917065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:46.942756 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:47.021328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 335/659] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:47.023131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933238a-b2eb-4e3f-976a-b4f26c1fd5c8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:47.090591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:47.109374 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8d370-46c1-40c4-a149-7bc3f3df72d3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:47.169144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088586f8-eb53-4582-9ff0-640cdf792258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:47.170180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088586f8-eb53-4582-9ff0-640cdf792258 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:47.170694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088586f8-eb53-4582-9ff0-640cdf792258 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:47.171164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088586f8-eb53-4582-9ff0-640cdf792258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:47.186570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933238a-b2eb-4e3f-976a-b4f26c1fd5c8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:47.232418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b29ad-71b2-4842-a6ce-13a0008c40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:47.232973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b29ad-71b2-4842-a6ce-13a0008c40ae None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:47.233250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b29ad-71b2-4842-a6ce-13a0008c40ae None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:47.233517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b29ad-71b2-4842-a6ce-13a0008c40ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:47.253047 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088586f8-eb53-4582-9ff0-640cdf792258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:47.254964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088586f8-eb53-4582-9ff0-640cdf792258 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:47.274039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:47.319374 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b29ad-71b2-4842-a6ce-13a0008c40ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:47.321239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b29ad-71b2-4842-a6ce-13a0008c40ae None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:47.360534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:47.375835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 325/660] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:47.377578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9837db7-1e47-42c9-a43a-e522e42dcd69 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:47.378095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9837db7-1e47-42c9-a43a-e522e42dcd69 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:47.378600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9837db7-1e47-42c9-a43a-e522e42dcd69 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:47.380664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 326/661] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:47.381744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9837db7-1e47-42c9-a43a-e522e42dcd69 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:47.492386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 336/662] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:47.492386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b29ad-71b2-4842-a6ce-13a0008c40ae None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:47.569279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9837db7-1e47-42c9-a43a-e522e42dcd69 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:47.601942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:47.635512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff84ad1-72ee-43b7-becf-8b0a343bfb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:47.636441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff84ad1-72ee-43b7-becf-8b0a343bfb7e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:47.637038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff84ad1-72ee-43b7-becf-8b0a343bfb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:47.637509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff84ad1-72ee-43b7-becf-8b0a343bfb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:47.643138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b29ad-71b2-4842-a6ce-13a0008c40ae None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:47.656748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff84ad1-72ee-43b7-becf-8b0a343bfb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:47.659436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff84ad1-72ee-43b7-becf-8b0a343bfb7e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:47.682709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:47.683404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:47.683679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:47.683945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:47.686441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-6ff84ad1-72ee-43b7-becf-8b0a343bfb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:47.690702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:47.692101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:47.692975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:47.692975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:47.692975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:47.693143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 327/663] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:47.695406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac20264-dbf8-4299-9846-577320c29548 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:47.695831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac20264-dbf8-4299-9846-577320c29548 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:47.696155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac20264-dbf8-4299-9846-577320c29548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:47.707972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:47.711332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:47.728398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4ac20264-dbf8-4299-9846-577320c29548 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:47.730304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4ac20264-dbf8-4299-9846-577320c29548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:47.740013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:47.740984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:47.741882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:47.741882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:47.741882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:47.742050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 337/664] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:47.744230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:47.866824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 328/665] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:47.868172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac20264-dbf8-4299-9846-577320c29548 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:47.919442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcb0b3-87ca-40a8-973e-8ab556d53025 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:48.003434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:48.006323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:48.006846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:48.007295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:48.032403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:48.036698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:48.065329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:48.066323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:48.067238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:48.067238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:48.067238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:48.072147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 338/666] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:48.073049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:48.109962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:48.116582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac20264-dbf8-4299-9846-577320c29548 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:48.150557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:48.194770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:48.195798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:48.197172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:48.197769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:48.199419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:48.200046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:48.202194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:48.225825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 329/667] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:48.232216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:48.295944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d48e-c499-4bcf-baaf-603d72f25b44 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:48.375811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:48.376833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:48.377304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:48.377758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:48.378939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:48.379446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:48.382033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:48.403320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4a82a-e28f-4bfd-a5bd-cd19ab27514d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:48.417310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 339/668] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:48.419100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:48.464697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:48.465776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:48.466481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:48.467438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:48.468784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:48.469285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:48.470989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:48.491887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 330/669] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:48.492790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:48.530108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:48.587145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:48.590762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979665-bdfd-4499-acdc-021b5d9db807 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:48.648506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:48.649963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:48.650667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:48.651154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:48.662853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:48.665084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:48.678754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42aef8-7495-4d0b-867c-bb2175080674 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:48.682722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:48.684472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 340/670] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:48.686288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:48.755455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb991100-9794-4a3a-8fb4-725bab65753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:48.756792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb991100-9794-4a3a-8fb4-725bab65753d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:48.757373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb991100-9794-4a3a-8fb4-725bab65753d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:48.757858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb991100-9794-4a3a-8fb4-725bab65753d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:48.781813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb991100-9794-4a3a-8fb4-725bab65753d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-bb991100-9794-4a3a-8fb4-725bab65753d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:48.792876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:48.793891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:48.794736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:48.795467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 331/671] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:48.797327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891779-4d39-4856-b342-d94226e4a8bb None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:48.797827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891779-4d39-4856-b342-d94226e4a8bb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:48.798311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891779-4d39-4856-b342-d94226e4a8bb None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:48.801074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 332/672] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:48.802610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06891779-4d39-4856-b342-d94226e4a8bb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:48.824337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34e12-0bbe-49ef-9ab8-1fc1478855b4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:48.894993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:48.896055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:48.896545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:48.897024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:48.913811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:48.917739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:48.938079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:48.943919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:48.945513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 341/673] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:48.946517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:48.976695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:48.977925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06891779-4d39-4856-b342-d94226e4a8bb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:49.026959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:49.027806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:49.028086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:49.028357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:49.036529 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:49.037997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:49.050443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:49.052385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 333/674] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:49.054317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:49.132846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed3eac-0f1e-481c-b264-bfd50c1de7b7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:49.192672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856dad7-49d7-4e02-84e2-183b867aabe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:49.193307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856dad7-49d7-4e02-84e2-183b867aabe5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:49.193650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856dad7-49d7-4e02-84e2-183b867aabe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:49.193992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856dad7-49d7-4e02-84e2-183b867aabe5 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:49.194795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856dad7-49d7-4e02-84e2-183b867aabe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:49.195103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856dad7-49d7-4e02-84e2-183b867aabe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:49.196811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856dad7-49d7-4e02-84e2-183b867aabe5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:49.212660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 342/675] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:49.213912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c6432-eeeb-4283-9e38-02b637a11e4b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:49.214195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c6432-eeeb-4283-9e38-02b637a11e4b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:49.214730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c6432-eeeb-4283-9e38-02b637a11e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:49.244340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c44c6432-eeeb-4283-9e38-02b637a11e4b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:49.244607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a09a6-f2b7-489a-a5bb-cbf62c3e3671 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:49.246652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c44c6432-eeeb-4283-9e38-02b637a11e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:49.303107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:49.303739 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:49.304013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:49.304275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:49.304947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:49.305243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:49.306782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:49.313528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:49.316945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 334/676] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:30:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:49.317708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:49.377838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 343/677] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:49.378619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c6432-eeeb-4283-9e38-02b637a11e4b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:49.391569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:49.497706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226455f8-616d-4b09-9e8c-5e3d5e662d3a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:49.559479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:49.561534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:49.562115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:49.562717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:49.564115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:49.564870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:49.567836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:49.569263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c6432-eeeb-4283-9e38-02b637a11e4b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:49.607268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 335/678] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:49.609282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:49.615474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:49.616517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:49.616966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:49.617460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:49.618544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:49.619342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:49.621206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:49.642624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 344/679] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:49.643641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:49.723280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:49.741834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:49.788287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c3e9b-afb8-47ca-9320-e9af5d9c29d0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:49.796078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a58ecb-33e9-416f-97c4-7b2adcf83157 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:49.845922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:49.847036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:49.847510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:49.847988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:49.849354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=89357dc69c8f456580613061f2cbef07) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:49.849910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:49.852660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:49.862306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:49.863121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:49.863401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:49.863664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:49.865270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 336/680] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:49 2022] GET /identity/v3/role_assignments?user.id=89357dc69c8f456580613061f2cbef07&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:49.867526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:49.879981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:49.882357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:49.900935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:49.902900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:49.904655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:49.904655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:49.904655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:49.904655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 345/681] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:49.905129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:50.062466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf69b29-59a5-4b0e-bdbc-3c8e86129e57 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:50.097496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e67df-81a4-4c1d-bb25-fd4c8e7744b9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:50.115389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:50.133454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:50.134198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:50.134623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:50.134901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:50.135730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=906464ed50294dc481c4d1d570a5195b) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:50.135953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:50.137436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:50.142156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:50.147221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 337/682] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:49 2022] GET /identity/v3/role_assignments?user.id=906464ed50294dc481c4d1d570a5195b&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:50.148785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:50.168105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:50.169113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:50.169585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:50.170073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:50.171151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=6b24f12951bd4220afad25f23f566f6d) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:50.171682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:50.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:50.186904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 346/683] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:49 2022] GET /identity/v3/role_assignments?user.id=6b24f12951bd4220afad25f23f566f6d&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:50.188257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:50.305137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e1e74-0959-4e23-b5c4-ebf8759c86f0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:50.389895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:50.393835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:50.393835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:50.393835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:50.393835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:50.393835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:50.413562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:50.414702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:30:50.415599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:50.421362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 338/684] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Aug 30 14:30:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:50.424164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:50.459302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c0f92-f201-4be3-bd91-4f37d84b19c3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:50.536794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:50.539029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:50.540747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:50.541409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:50.542305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:50.542834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:50.545171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:50.545299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:50.562771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 347/685] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:50.568717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:50.655827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:50.675583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1305b-8b43-4aa3-aa84-59c9a80110ba None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:50.748408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8416a4-6ade-48b8-83e7-8dde97a4c7a1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:50.768693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:50.769791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:50.769791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:50.769959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:50.770511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:50.770819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:50.772269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:50.786340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 339/686] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Aug 30 14:30:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:50.788591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:50.830271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:50.831403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:50.831900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:50.832399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:50.842024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:50.843945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:50.871093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:50.872123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:30:50.873057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:50.882640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 348/687] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:30:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:50.884920 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:51.092190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaae2ff-aaaa-4ee8-a4bc-9d9927b46d8e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:51.134331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa83c-6ed4-48c3-9d11-18b08f24ec57 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:51.136584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:51.139024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:51.191594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:51.191813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:51.192070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:51.192342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:51.192991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:51.193297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:51.194754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:51.209199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:51.210672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:51.211334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:51.211915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:51.212943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:51.213476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:51.222600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 340/688] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Aug 30 14:30:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:51.223935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:51.257527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 349/689] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Aug 30 14:30:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:51.259977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:51.402884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767f1a-a359-467f-997c-8c6662bade7e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:51.445218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efa677-7c6e-4a78-8ef9-2cc7175e1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:51.446327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efa677-7c6e-4a78-8ef9-2cc7175e1036 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:51.446864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efa677-7c6e-4a78-8ef9-2cc7175e1036 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:51.447541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efa677-7c6e-4a78-8ef9-2cc7175e1036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:51.519188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:51.533200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efa677-7c6e-4a78-8ef9-2cc7175e1036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:51.535115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efa677-7c6e-4a78-8ef9-2cc7175e1036 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:51.662599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 341/690] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:51.665518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:51.790085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1df55-6151-42f3-8417-adf6c4e963f4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:51.830934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:51.831963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:51.832440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:51.832924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:51.847289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:51.849187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:51.866410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:51.867435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:51.868479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:51.868479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:51.868479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:51.874621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 350/691] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:51.880035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efa677-7c6e-4a78-8ef9-2cc7175e1036 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:51.979180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:52.002125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efa677-7c6e-4a78-8ef9-2cc7175e1036 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:52.044883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:52.045920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:52.046438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:52.047002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:52.047929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:52.048681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:52.050312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:52.072012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 342/692] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:52.074007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:52.093580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:52.197522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01d73c-5e0d-42db-9346-a1d0f392d0ef None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:52.240905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeacbc6-53db-453d-b016-f12170ca80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:52.243275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeacbc6-53db-453d-b016-f12170ca80e3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:52.244123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeacbc6-53db-453d-b016-f12170ca80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:52.244890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeacbc6-53db-453d-b016-f12170ca80e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:52.259418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeacbc6-53db-453d-b016-f12170ca80e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:52.262163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeacbc6-53db-453d-b016-f12170ca80e3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-adeacbc6-53db-453d-b016-f12170ca80e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:30:52.291164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:52.293509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:52.295410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:30:52.295410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:30:52.295410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:30:52.295410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:30:52.295410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:30:52.295410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:30:52.295410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:30:52.295410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:52.299326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 351/693] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:52.304362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:52.512480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6363cd-ea2f-4f0f-9697-131a8ca028dd None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:52.557414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3fb9-055a-48f0-ab1f-f48cea95d540 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:52.557878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3fb9-055a-48f0-ab1f-f48cea95d540 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:52.558341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3fb9-055a-48f0-ab1f-f48cea95d540 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:52.561104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 352/694] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:52.567359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e76836-d9b3-4525-88a4-065f1f567cef None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:52.567853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e76836-d9b3-4525-88a4-065f1f567cef None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:52.568314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e76836-d9b3-4525-88a4-065f1f567cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:52.613120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:52.614169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:52.614691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:52.615159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:52.616420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:52.616825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:52.618925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:52.632631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-79e76836-d9b3-4525-88a4-065f1f567cef None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:52.634857 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-79e76836-d9b3-4525-88a4-065f1f567cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:52.666564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:52.687531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 343/695] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:52.701953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:52.953102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 353/696] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:53.042016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f177-6e06-48d9-a844-d28bb879b72c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:53.101962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037385-2e42-4840-83b7-773486b3797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:53.103590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037385-2e42-4840-83b7-773486b3797b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:53.103590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037385-2e42-4840-83b7-773486b3797b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:53.104052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037385-2e42-4840-83b7-773486b3797b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:53.105477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037385-2e42-4840-83b7-773486b3797b None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=b4639f179d4b4bb7b1fae6a8cf28d919) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:53.106016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037385-2e42-4840-83b7-773486b3797b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:53.108881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037385-2e42-4840-83b7-773486b3797b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:53.127949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 344/697] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:30:52 2022] GET /identity/v3/role_assignments?user.id=b4639f179d4b4bb7b1fae6a8cf28d919&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 608 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:30:53.485908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b514f20-0087-4ef1-887f-ddaf71a0309a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:53.486742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b514f20-0087-4ef1-887f-ddaf71a0309a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:53.486742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b514f20-0087-4ef1-887f-ddaf71a0309a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:53.487865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 354/698] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:53.502974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7e99e-d44a-4468-b05a-e2c03e502b43 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:53.502974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7e99e-d44a-4468-b05a-e2c03e502b43 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:53.502974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7e99e-d44a-4468-b05a-e2c03e502b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:53.534415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-63c7e99e-d44a-4468-b05a-e2c03e502b43 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:53.534415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-63c7e99e-d44a-4468-b05a-e2c03e502b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:53.654514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b514f20-0087-4ef1-887f-ddaf71a0309a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:53.658845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:53.695931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:53.717617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 345/699] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:53.821844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b514f20-0087-4ef1-887f-ddaf71a0309a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:53.862348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e11c-29f0-4c1b-83a4-c54114dd87df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:53.863045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e11c-29f0-4c1b-83a4-c54114dd87df None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:53.863319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e11c-29f0-4c1b-83a4-c54114dd87df None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:53.863583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e11c-29f0-4c1b-83a4-c54114dd87df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:53.876142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96e11c-29f0-4c1b-83a4-c54114dd87df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:53.877672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96e11c-29f0-4c1b-83a4-c54114dd87df None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5e96e11c-29f0-4c1b-83a4-c54114dd87df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:53.900350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:53.903593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:53.905276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:53.905276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:53.905276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:53.905276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 355/700] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:53.911213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7e99e-d44a-4468-b05a-e2c03e502b43 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:53.943489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0073-5a5a-4824-9f83-5dd01b25f88b None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:53.943769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0073-5a5a-4824-9f83-5dd01b25f88b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:53.944096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0073-5a5a-4824-9f83-5dd01b25f88b None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:53.945716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 356/701] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:53.952198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469cfff-ad2f-4b5f-b780-636f56513dd3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:53.952432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469cfff-ad2f-4b5f-b780-636f56513dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:53.952801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469cfff-ad2f-4b5f-b780-636f56513dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:53.993559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1469cfff-ad2f-4b5f-b780-636f56513dd3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:53.996519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1469cfff-ad2f-4b5f-b780-636f56513dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:54.039704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7e99e-d44a-4468-b05a-e2c03e502b43 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:54.121170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:54.121825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:54.122124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:54.122451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:54.123187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:54.123497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:54.125536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:54.140223 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:54.173935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 357/702] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 14:30:54.174234 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 346/703] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:54.184523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469cfff-ad2f-4b5f-b780-636f56513dd3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:54.351271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:54.426962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469cfff-ad2f-4b5f-b780-636f56513dd3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:54.522418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f64a-7335-4b40-99f8-652131e8c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:54.522418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f64a-7335-4b40-99f8-652131e8c3d6 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:54.522418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f64a-7335-4b40-99f8-652131e8c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:54.522418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f64a-7335-4b40-99f8-652131e8c3d6 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:54.523284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f64a-7335-4b40-99f8-652131e8c3d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:54.526785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f64a-7335-4b40-99f8-652131e8c3d6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:54.604359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 358/704] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:30:54 2022] POST /identity/v3/users => generated 254 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:30:54.619530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:54.624500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441535e-84a4-4282-a312-ede1a87f60d7 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:54.628351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441535e-84a4-4282-a312-ede1a87f60d7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:54.628351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441535e-84a4-4282-a312-ede1a87f60d7 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:54.628751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 359/705] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:30:54.630141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441535e-84a4-4282-a312-ede1a87f60d7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:54.758177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:54.767315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbdd7e-56db-4850-9423-6dcfda4ca58e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:54.845733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957380ab-5cc8-42dd-84f6-88b3b34f7721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:54.847356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957380ab-5cc8-42dd-84f6-88b3b34f7721 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:54.848381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957380ab-5cc8-42dd-84f6-88b3b34f7721 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:54.851591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957380ab-5cc8-42dd-84f6-88b3b34f7721 None admin] PATH_INFO: `/v3/services/network` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:54.853183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957380ab-5cc8-42dd-84f6-88b3b34f7721 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:54.856381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957380ab-5cc8-42dd-84f6-88b3b34f7721 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-957380ab-5cc8-42dd-84f6-88b3b34f7721 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:54.881495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:54.883671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:30:54.885347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:54.895036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 347/706] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:30:54 2022] GET /identity/v3/services/network => generated 88 bytes in 545 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:54.897790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50b4f-8f04-4bad-9475-3e41fe68fa70 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:54.898582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50b4f-8f04-4bad-9475-3e41fe68fa70 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:54.902611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50b4f-8f04-4bad-9475-3e41fe68fa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:54.929622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441535e-84a4-4282-a312-ede1a87f60d7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:54.941030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a6c50b4f-8f04-4bad-9475-3e41fe68fa70 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:54.943676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a6c50b4f-8f04-4bad-9475-3e41fe68fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:55.013936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76b63-fcc2-4626-a34c-19ecbb63d60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:55.015359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76b63-fcc2-4626-a34c-19ecbb63d60d None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:55.015826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76b63-fcc2-4626-a34c-19ecbb63d60d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:55.016458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76b63-fcc2-4626-a34c-19ecbb63d60d None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:55.018430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e76b63-fcc2-4626-a34c-19ecbb63d60d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:55.019794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e76b63-fcc2-4626-a34c-19ecbb63d60d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:55.058472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 360/707] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:30:54 2022] POST /identity/v3/services => generated 251 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:30:55.059872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76b63-fcc2-4626-a34c-19ecbb63d60d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:55.210224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 348/708] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:55.390954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76b63-fcc2-4626-a34c-19ecbb63d60d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:55.398423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:55.481116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:55.482667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:55.483449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:55.484213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:55.485644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] RBAC: Adding query filter params (name=network) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:55.486838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:55.489829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:55.505364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 361/709] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:30:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:55.515595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c50b4f-8f04-4bad-9475-3e41fe68fa70 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:55.640538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:55.705274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c50b4f-8f04-4bad-9475-3e41fe68fa70 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:55.750354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:55.750916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:55.751193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:55.754416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:55.754416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] RBAC: Adding query filter params (type=network) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:55.754416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:55.754416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:55.762663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 349/710] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:30:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:55.802304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:56.019405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc06ec9-0ded-453f-a7b9-23c022598c25 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:56.089025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959f825-1c55-4125-8753-48224fc48370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:56.090120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959f825-1c55-4125-8753-48224fc48370 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:56.090744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959f825-1c55-4125-8753-48224fc48370 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:56.091219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959f825-1c55-4125-8753-48224fc48370 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:56.114719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959f825-1c55-4125-8753-48224fc48370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8959f825-1c55-4125-8753-48224fc48370 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:56.126665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:56.128931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:30:56.130518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:56.137082 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 362/711] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:56.138788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:56.313547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48030563-6ab6-4b91-b172-92140f9a58e2 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:56.314204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48030563-6ab6-4b91-b172-92140f9a58e2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:56.314610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48030563-6ab6-4b91-b172-92140f9a58e2 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:56.317514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 363/712] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:56.327349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655864-5ac1-4b72-a62a-75714aa7a05e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:56.327883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655864-5ac1-4b72-a62a-75714aa7a05e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:56.328351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655864-5ac1-4b72-a62a-75714aa7a05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:56.341725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190f3a4-71aa-45d6-a476-6192d8402043 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:56.354412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:56.389399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-27655864-5ac1-4b72-a62a-75714aa7a05e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:56.389882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-27655864-5ac1-4b72-a62a-75714aa7a05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:56.395346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:56.395989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:56.396307 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:56.396613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:56.397332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:56.397662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:56.399156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:56.416332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 350/713] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:56.429108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:56.454963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:56.650911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 364/714] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:56.774435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a117e-a0e8-4d55-b03d-605221203e1a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:56.902528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:56.902788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:56.903189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:56.903506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:56.947517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:56.950290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:57.001135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:57.003051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:57.004842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:57.004842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:57.004842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:57.012872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 351/715] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 586 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:57.024214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27655864-5ac1-4b72-a62a-75714aa7a05e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:57.366177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27655864-5ac1-4b72-a62a-75714aa7a05e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:57.418446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:57.496385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:57.497291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:57.497535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:57.497819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:57.498095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:57.503089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:57.503089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:57.503089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:57.541121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 365/716] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:57.546127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:57.600204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:57.760358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8780cc-3dbf-4940-810e-23f5c12ea960 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:57.887560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee54b92-2763-4f31-bdf9-ed3aa71af3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:57.888302 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee54b92-2763-4f31-bdf9-ed3aa71af3bd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:57.888581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee54b92-2763-4f31-bdf9-ed3aa71af3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:57.888906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee54b92-2763-4f31-bdf9-ed3aa71af3bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:57.897276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e373f6-df0d-49ea-b4bb-50b850ac1ece None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:57.934052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee54b92-2763-4f31-bdf9-ed3aa71af3bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-dee54b92-2763-4f31-bdf9-ed3aa71af3bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:57.939572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:57.940627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:30:57.941493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:57.953554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 352/717] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 535 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:57.954613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee54b92-2763-4f31-bdf9-ed3aa71af3bd None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:57.989537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:57.990198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:57.990514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:57.990980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.006357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:58.014636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:58.041564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:58.043102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:30:58.044035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:58.045848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 366/718] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:30:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 499 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:58.054940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:58.115152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:58.137091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee54b92-2763-4f31-bdf9-ed3aa71af3bd None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:58.177071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7800b-7e0f-4d45-a4cf-12209b62de4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:58.177940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7800b-7e0f-4d45-a4cf-12209b62de4e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.178237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7800b-7e0f-4d45-a4cf-12209b62de4e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.179029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7800b-7e0f-4d45-a4cf-12209b62de4e None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.179761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7800b-7e0f-4d45-a4cf-12209b62de4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:58.180162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7800b-7e0f-4d45-a4cf-12209b62de4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:58.182026 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7800b-7e0f-4d45-a4cf-12209b62de4e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:58.197507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 353/719] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:58.199197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae788a-67ce-4830-bf56-04c08962984e None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.199587 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae788a-67ce-4830-bf56-04c08962984e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.199955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae788a-67ce-4830-bf56-04c08962984e None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.201801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 354/720] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:58.209029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae788a-67ce-4830-bf56-04c08962984e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:58.214820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:58.266791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f31e6-32b3-4d3c-bd06-41e55463cc8b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:58.319595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbc91d-ff69-43f6-8568-40eec3576789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:58.320356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc91d-ff69-43f6-8568-40eec3576789 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.320695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc91d-ff69-43f6-8568-40eec3576789 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.321061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc91d-ff69-43f6-8568-40eec3576789 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.321885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbc91d-ff69-43f6-8568-40eec3576789 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:58.322256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbc91d-ff69-43f6-8568-40eec3576789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:58.324133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbc91d-ff69-43f6-8568-40eec3576789 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:58.345550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae788a-67ce-4830-bf56-04c08962984e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:58.351371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 367/721] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:30:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:58.353267 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b738ae9-38e6-45f3-b426-f149e0f3399a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.353634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b738ae9-38e6-45f3-b426-f149e0f3399a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.353984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b738ae9-38e6-45f3-b426-f149e0f3399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.385578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2b738ae9-38e6-45f3-b426-f149e0f3399a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:58.389036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2b738ae9-38e6-45f3-b426-f149e0f3399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:58.397077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622b7a-322c-45f6-beae-76a0e369d794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:58.397733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622b7a-322c-45f6-beae-76a0e369d794 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.398010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622b7a-322c-45f6-beae-76a0e369d794 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.398276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622b7a-322c-45f6-beae-76a0e369d794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.413285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45622b7a-322c-45f6-beae-76a0e369d794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:58.414724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45622b7a-322c-45f6-beae-76a0e369d794 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:58.418468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-45622b7a-322c-45f6-beae-76a0e369d794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:58.438051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:58.439202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:58.440086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:58.440086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:58.440086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:58.447766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 355/722] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:30:58.449437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eb78f-eadf-4a59-8a6d-4f6066e29a03 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.449745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eb78f-eadf-4a59-8a6d-4f6066e29a03 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.450084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eb78f-eadf-4a59-8a6d-4f6066e29a03 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.457102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 356/723] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:58.458205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eb78f-eadf-4a59-8a6d-4f6066e29a03 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:58.514453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 368/724] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:58.514453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b738ae9-38e6-45f3-b426-f149e0f3399a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:58.598305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2eb78f-eadf-4a59-8a6d-4f6066e29a03 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:58.627662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:58.648347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91a301-aa33-46f3-afc1-c7e4e48561be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:58.649665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91a301-aa33-46f3-afc1-c7e4e48561be None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.650522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91a301-aa33-46f3-afc1-c7e4e48561be None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.651020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91a301-aa33-46f3-afc1-c7e4e48561be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.745639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b738ae9-38e6-45f3-b426-f149e0f3399a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:58.823679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:58.844700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91a301-aa33-46f3-afc1-c7e4e48561be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:58.846182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91a301-aa33-46f3-afc1-c7e4e48561be None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:58.849685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc6e64-01f8-4928-b6a1-490744fcd617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:58.850262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6e64-01f8-4928-b6a1-490744fcd617 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.850561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6e64-01f8-4928-b6a1-490744fcd617 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.850830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc6e64-01f8-4928-b6a1-490744fcd617 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.851491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc6e64-01f8-4928-b6a1-490744fcd617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:58.851786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc6e64-01f8-4928-b6a1-490744fcd617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:58.853357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc6e64-01f8-4928-b6a1-490744fcd617 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:58.870576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 369/725] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:58.872287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3662-7ec9-4a23-9354-38b0b5a5b8dc None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:58.872585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3662-7ec9-4a23-9354-38b0b5a5b8dc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:58.872834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3662-7ec9-4a23-9354-38b0b5a5b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:58.902767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9bde3662-7ec9-4a23-9354-38b0b5a5b8dc None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:58.903982 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9bde3662-7ec9-4a23-9354-38b0b5a5b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:59.006452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 370/726] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:59.007802 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde3662-7ec9-4a23-9354-38b0b5a5b8dc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:59.037432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 357/727] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:58 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:30:59.037432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91a301-aa33-46f3-afc1-c7e4e48561be None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:59.108946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:59.164894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:59.174572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91a301-aa33-46f3-afc1-c7e4e48561be None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:59.203622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde3662-7ec9-4a23-9354-38b0b5a5b8dc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:59.239873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:59.240539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.240814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.241138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.256522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:59.259386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:30:59.277604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:59.278932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:30:59.279903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:59.282097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 358/728] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:30:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:59.283457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:59.283646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c34b87-81a5-4bf8-b574-6127a388592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:59.284681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c34b87-81a5-4bf8-b574-6127a388592a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.284900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c34b87-81a5-4bf8-b574-6127a388592a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.285173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c34b87-81a5-4bf8-b574-6127a388592a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.285854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c34b87-81a5-4bf8-b574-6127a388592a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:59.287700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c34b87-81a5-4bf8-b574-6127a388592a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-b8c34b87-81a5-4bf8-b574-6127a388592a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:59.303760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:59.304798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:59.306578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 371/729] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Aug 30 14:30:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:59.308487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73b23-a30f-439d-b7ca-9cdb7087eba3 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.308930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73b23-a30f-439d-b7ca-9cdb7087eba3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.309357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73b23-a30f-439d-b7ca-9cdb7087eba3 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.318733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 372/730] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:30:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:30:59.320323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73b23-a30f-439d-b7ca-9cdb7087eba3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:59.439750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638b1a3-38a1-4d13-aa9f-9b37a76ca822 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:59.468882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73b23-a30f-439d-b7ca-9cdb7087eba3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:59.489437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:59.490568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.491042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.491523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.492396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:59.511074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:59.512622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:59.516744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dbe19-be56-4bab-9ec0-e0b8d679f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:59.517357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbe19-be56-4bab-9ec0-e0b8d679f7ae None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.517633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbe19-be56-4bab-9ec0-e0b8d679f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.517905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbe19-be56-4bab-9ec0-e0b8d679f7ae None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.518678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dbe19-be56-4bab-9ec0-e0b8d679f7ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:59.518981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dbe19-be56-4bab-9ec0-e0b8d679f7ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:59.520445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dbe19-be56-4bab-9ec0-e0b8d679f7ae None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:30:59.530882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:59.532324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:30:59.533623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:30:59.533623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:30:59.533623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:30:59.533623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 359/731] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:59.533623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:59.547878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:59.551150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 373/732] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Aug 30 14:30:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:59.552500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba9e7-4d6d-4add-a926-acf1cc822c73 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.552782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba9e7-4d6d-4add-a926-acf1cc822c73 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.553053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba9e7-4d6d-4add-a926-acf1cc822c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.577393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2f3ba9e7-4d6d-4add-a926-acf1cc822c73 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:30:59.578969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2f3ba9e7-4d6d-4add-a926-acf1cc822c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:30:59.668518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb958ba-6553-408c-a572-e3f7d4ab610f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:59.678411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 374/733] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:30:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 14:30:59.678411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ba9e7-4d6d-4add-a926-acf1cc822c73 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:59.731426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:59.732661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.733143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.733616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.734773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:59.735274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:59.737700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:30:59.748568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 360/734] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Aug 30 14:30:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:30:59.749902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:59.846896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ba9e7-4d6d-4add-a926-acf1cc822c73 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:59.858346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:59.883831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:30:59.905719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d588-7504-4aa7-9932-3e2e2edde089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:59.906728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d588-7504-4aa7-9932-3e2e2edde089 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.907196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d588-7504-4aa7-9932-3e2e2edde089 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.907667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d588-7504-4aa7-9932-3e2e2edde089 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.925829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea701-51fd-4782-95f9-232dd82f4d8d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:30:59.928614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556d588-7504-4aa7-9932-3e2e2edde089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c556d588-7504-4aa7-9932-3e2e2edde089 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:30:59.935664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:30:59.936654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:30:59.937477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:30:59.938105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 375/735] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:30:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:30:59.939032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d588-7504-4aa7-9932-3e2e2edde089 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:30:59.978177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:30:59.979101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:30:59.979210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:30:59.979419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:30:59.980710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:30:59.980710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:30:59.982855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:00.005829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 361/736] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:00.006777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:00.095009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d588-7504-4aa7-9932-3e2e2edde089 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:00.150421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d009a-2bbc-4582-8bde-9eb28f85b0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:00.151400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d009a-2bbc-4582-8bde-9eb28f85b0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:00.151842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d009a-2bbc-4582-8bde-9eb28f85b0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:00.152259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d009a-2bbc-4582-8bde-9eb28f85b0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:00.152354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd9aa-86b3-4719-934b-e86d24b00670 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:00.199389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:00.203950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:00.205517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:00.206571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:00.208910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:00.208910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:00.209305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:00.209863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:00.212260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:00.227704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 362/737] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Aug 30 14:31:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:00.227704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:00.254638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d009a-2bbc-4582-8bde-9eb28f85b0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:00.256151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d009a-2bbc-4582-8bde-9eb28f85b0c1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:00.354781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd4954-06a5-4c37-927a-12b50bbecc88 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:00.388135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 376/738] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:30:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 14:31:00.389003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d009a-2bbc-4582-8bde-9eb28f85b0c1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:00.406776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dce7a-f2dd-4fc0-a994-0192b6ec9d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:00.407831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dce7a-f2dd-4fc0-a994-0192b6ec9d43 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:00.408449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dce7a-f2dd-4fc0-a994-0192b6ec9d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:00.408940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dce7a-f2dd-4fc0-a994-0192b6ec9d43 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:00.410179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dce7a-f2dd-4fc0-a994-0192b6ec9d43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:00.412724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dce7a-f2dd-4fc0-a994-0192b6ec9d43 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:00.436606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 363/739] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:31:00 2022] POST /identity/v3/services => generated 240 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:00.442681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dce7a-f2dd-4fc0-a994-0192b6ec9d43 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:00.507012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:00.553869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d009a-2bbc-4582-8bde-9eb28f85b0c1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:00.554554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:00.617417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:00.618303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:00.618817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:00.619247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:00.620911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:00.621394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:00.623698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:00.642442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 377/740] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:31:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:00.642442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:00.645524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dce7a-f2dd-4fc0-a994-0192b6ec9d43 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:00.714960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:00.715534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:00.716150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:00.717166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:00.733547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:00.735363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:00.750970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:00.752003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:00.752914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 364/741] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:00.753417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:00.820675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d8649-bb53-411c-ab57-c78c705793d6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:00.855498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:00.875344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:00.876646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:00.877135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:00.877599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:00.879154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] RBAC: Adding query filter params (interface=public, service_id=1a2f4e22a2e94161bab2c87eede72a2c, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:00.879917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:00.881726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:00.894678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 378/742] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Aug 30 14:31:00 2022] GET /identity/v3/endpoints?service_id=1a2f4e22a2e94161bab2c87eede72a2c&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:00.896220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:00.966638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95234c33-6a1e-40e2-97ce-be0fd557f9f1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:00.998607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:01.030457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:01.030457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:01.030457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:01.030457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:01.041022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:01.042807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:01.056528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24a64c-4836-4a4d-a7c0-c17fe4409235 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:01.059297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:01.060266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:01.061141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:01.061141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:01.061141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:01.065715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 365/743] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:01.066744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:01.105432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:01.106614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:01.107057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:01.107476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:01.122529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:01.124443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:01.175477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:01.176906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:01.177836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:01.177836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:01.177836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:01.185675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 379/744] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:01.187449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:01.274521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:01.355165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5455d-2094-469c-b6bf-d37380b8b7e8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:01.395685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d4af-32d7-47b5-a461-caf4aa93ff3c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:01.411974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c78f30-24e4-4251-ab1a-17975ff49bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:01.413414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c78f30-24e4-4251-ab1a-17975ff49bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:01.414076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c78f30-24e4-4251-ab1a-17975ff49bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:01.415841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c78f30-24e4-4251-ab1a-17975ff49bb0 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:01.419914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c78f30-24e4-4251-ab1a-17975ff49bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:01.422710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c78f30-24e4-4251-ab1a-17975ff49bb0 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:01.436534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 380/745] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:31:01 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:01.438478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c78f30-24e4-4251-ab1a-17975ff49bb0 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:01.513642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:01.516202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:01.516906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:01.517354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:01.518713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:01.519216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:01.523864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:01.573788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 366/746] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:01.580235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:01.661256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:01.761762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c78f30-24e4-4251-ab1a-17975ff49bb0 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:01.767858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:01.788844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61bf54-5354-4b44-b7d9-6ea93930bd8c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:01.829320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:01.832474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:01.833322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:01.835089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:01.836785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:01.837784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:01.840698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:01.865941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 381/747] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:01.869201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:01.907507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:01.908536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:01.908998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:01.909457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:01.911201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:01.914066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:01.919543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:01.974074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 367/748] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:01.978274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:02.082454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddf123-0236-4a33-a041-39426cc0e136 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:02.152074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:02.153644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:02.155549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:02.156307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:02.157858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=fabb84470909411f80adffac902dea45, user.id=906464ed50294dc481c4d1d570a5195b) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:02.159375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:02.165393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:02.176898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 382/749] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:01 2022] GET /identity/v3/role_assignments?user.id=906464ed50294dc481c4d1d570a5195b&scope.project.id=fabb84470909411f80adffac902dea45&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:02.179722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:02.237551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:02.441135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:02.504688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d213b-7c5c-4d19-9d99-5a01e377e297 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:02.571729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a502f14-7607-4351-94c8-31a351394d0f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:02.677286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:02.686621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:02.686621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:02.686621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:02.703688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:02.705106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:02.705780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:02.707403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:02.707874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:02.709050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:02.737294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:02.746822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:02.750706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:02.752261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:02.753908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 368/750] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 777 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:02.763554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:02.788829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:02.795197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:02.797033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 383/751] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:31:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 614 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:02.804402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:02.970713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5fc0-0254-4199-a6ca-5ae114b3762a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:03.049439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:03.062875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:03.063514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:03.063793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:03.064061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:03.064769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:03.065071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:03.072552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:03.079277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2203eb-6490-4b80-93c5-cd3f749c44d8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:03.116569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 369/752] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:03.126611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:03.128748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:03.128748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:03.129089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:03.129089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:03.129865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:03.130197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:03.134489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:03.162483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 384/753] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Aug 30 14:31:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:03.163438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:03.165137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:03.416950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7e48a-b341-409b-b7dd-97ebd10f95db None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:03.572830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2fd68-05a1-4726-a4f8-aa8a90ae11bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:03.577255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2fd68-05a1-4726-a4f8-aa8a90ae11bd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:03.579346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2fd68-05a1-4726-a4f8-aa8a90ae11bd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:03.581402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2fd68-05a1-4726-a4f8-aa8a90ae11bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:03.587221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2fd68-05a1-4726-a4f8-aa8a90ae11bd None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=fabb84470909411f80adffac902dea45, user.id=b4639f179d4b4bb7b1fae6a8cf28d919) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:03.589584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2fd68-05a1-4726-a4f8-aa8a90ae11bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:03.599174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2fd68-05a1-4726-a4f8-aa8a90ae11bd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:03.633423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 370/754] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:03 2022] GET /identity/v3/role_assignments?user.id=b4639f179d4b4bb7b1fae6a8cf28d919&scope.project.id=fabb84470909411f80adffac902dea45&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 259 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:03.643667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759adfc-58a8-4e85-891b-739595258d6b None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:03.645817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759adfc-58a8-4e85-891b-739595258d6b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:03.649122 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759adfc-58a8-4e85-891b-739595258d6b None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:03.653244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 371/755] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:03 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:03.659869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd2f6-41d7-4f46-85fd-fcd175162dbb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:03.659869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd2f6-41d7-4f46-85fd-fcd175162dbb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:03.659869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd2f6-41d7-4f46-85fd-fcd175162dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:03.674169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265caa0-c0d6-4686-9398-7fdd32e80510 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:03.680570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-259fd2f6-41d7-4f46-85fd-fcd175162dbb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:03.682851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-259fd2f6-41d7-4f46-85fd-fcd175162dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:03.785229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 372/756] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:03.828395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1afbb7-fda3-4754-a4a5-1856b6ad60ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:03.830508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1afbb7-fda3-4754-a4a5-1856b6ad60ec None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:03.830508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1afbb7-fda3-4754-a4a5-1856b6ad60ec None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:03.830508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1afbb7-fda3-4754-a4a5-1856b6ad60ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:03.894103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:04.152613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1afbb7-fda3-4754-a4a5-1856b6ad60ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:04.159411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1afbb7-fda3-4754-a4a5-1856b6ad60ec None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:04.180072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fd2f6-41d7-4f46-85fd-fcd175162dbb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:04.190414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:04.480898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 385/757] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 1316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:31:04.487639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1afbb7-fda3-4754-a4a5-1856b6ad60ec None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:04.548849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:04.620283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fd2f6-41d7-4f46-85fd-fcd175162dbb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:04.679827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1afbb7-fda3-4754-a4a5-1856b6ad60ec None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:04.711726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74c4d5-6522-4e49-b24b-6dd7ded2a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:04.715878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c4d5-6522-4e49-b24b-6dd7ded2a845 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:04.716742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c4d5-6522-4e49-b24b-6dd7ded2a845 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:04.717404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c4d5-6522-4e49-b24b-6dd7ded2a845 None admin] PATH_INFO: `/v3/services/network` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:04.719745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74c4d5-6522-4e49-b24b-6dd7ded2a845 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:04.723035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74c4d5-6522-4e49-b24b-6dd7ded2a845 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:04.733373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395abfd4-a4c7-40bd-a09a-9fa837180cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ed74c4d5-6522-4e49-b24b-6dd7ded2a845 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:04.733958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:04.735695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:31:04.737556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:04.740188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 373/758] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:04 2022] GET /identity/v3/services/network => generated 88 bytes in 561 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:04.741255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abfd4-a4c7-40bd-a09a-9fa837180cab None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:04.741635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a7ac0-2a02-4acc-900b-c46abfbe777f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:04.741919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a7ac0-2a02-4acc-900b-c46abfbe777f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:04.742192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a7ac0-2a02-4acc-900b-c46abfbe777f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:04.742906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abfd4-a4c7-40bd-a09a-9fa837180cab None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:04.744479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 374/759] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:04.744775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abfd4-a4c7-40bd-a09a-9fa837180cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:04.745473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a7ac0-2a02-4acc-900b-c46abfbe777f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:04.767373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395abfd4-a4c7-40bd-a09a-9fa837180cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:04.771114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395abfd4-a4c7-40bd-a09a-9fa837180cab None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-395abfd4-a4c7-40bd-a09a-9fa837180cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:04.805470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:04.808136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:04.809838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:04.809838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:04.809838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:04.814331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 386/760] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:04.817052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2d7b-6af5-452f-bde0-28831acfe7e6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:04.817892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2d7b-6af5-452f-bde0-28831acfe7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:04.819105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2d7b-6af5-452f-bde0-28831acfe7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:04.830629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:04.857219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-02bb2d7b-6af5-452f-bde0-28831acfe7e6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:04.859724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-02bb2d7b-6af5-452f-bde0-28831acfe7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:04.871355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a7ac0-2a02-4acc-900b-c46abfbe777f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:04.912398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:04.913040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:04.913310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:04.913577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:04.914224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] RBAC: Adding query filter params (name=network) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:04.914686 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:04.916692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:04.921921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 375/761] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:04.927610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:05.019888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 387/762] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:05.021834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb2d7b-6af5-452f-bde0-28831acfe7e6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:05.075647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43ba30-a4c3-4a27-a414-3c434037b781 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:05.091924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:05.156297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:05.181507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:05.182147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:05.182449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:05.182721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:05.183428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:05.183671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:05.185074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:05.213895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 376/763] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:05.220010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:05.278673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb2d7b-6af5-452f-bde0-28831acfe7e6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:05.349616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:05.351302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:05.352362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:05.353945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:05.355499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] RBAC: Adding query filter params (type=network) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:05.356362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:05.359330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:05.373229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 388/764] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:05.384781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:05.506421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a742ec-4cbc-4410-bd91-8d964102b58c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:05.511753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:05.525279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729e5d-d519-406f-9d44-26cfebb5673a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:05.580690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:05.581913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:05.582194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:05.582518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:05.583210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] RBAC: Adding query filter params (interface=public, service_id=f45eb16f4c684c98ac3851926a9b11bc, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:05.583525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:05.584941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:05.596709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 389/765] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Aug 30 14:31:05 2022] GET /identity/v3/endpoints?service_id=f45eb16f4c684c98ac3851926a9b11bc&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:05.598814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:05.611303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:05.611303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:05.611726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:05.611726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:05.623905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:05.625477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:05.653387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:05.655154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:05.656909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:05.656909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:05.656909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:05.656909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:05.656909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:05.656909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:05.656909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:05.656909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:05.661416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 377/766] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:05.663446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:05.756361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:05.768070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb9ec5-86c1-4a1a-ad04-fa8f9bc4fa24 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:05.825562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:05.827417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:05.827417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:05.827417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:05.827813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:05.829243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:05.841049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:05.842917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:05.844495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 390/767] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Aug 30 14:31:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:05.845990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:05.861009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a680d-bbec-4b19-aed2-1dee63604297 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:05.881456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:05.929738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbda34-5de6-44f5-9f54-fa9e7e0b6427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:05.931136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbda34-5de6-44f5-9f54-fa9e7e0b6427 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:05.931553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbda34-5de6-44f5-9f54-fa9e7e0b6427 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:05.932030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbda34-5de6-44f5-9f54-fa9e7e0b6427 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:05.933120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbda34-5de6-44f5-9f54-fa9e7e0b6427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:05.935729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbda34-5de6-44f5-9f54-fa9e7e0b6427 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:05.946940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 378/768] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:31:05 2022] GET /identity/v3/services => generated 772 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:05.949312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a3ab-3203-42df-baed-87429b557777 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:05.949799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a3ab-3203-42df-baed-87429b557777 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:05.950295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a3ab-3203-42df-baed-87429b557777 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:05.957605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 379/769] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:05.957605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6a3ab-3203-42df-baed-87429b557777 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:06.030869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b0dc4-2a41-4c51-9673-460264ee683b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:06.100370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110660f-abaa-400b-b547-d37dce85346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:06.100941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110660f-abaa-400b-b547-d37dce85346d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:06.101218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110660f-abaa-400b-b547-d37dce85346d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:06.101483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110660f-abaa-400b-b547-d37dce85346d None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:06.102368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110660f-abaa-400b-b547-d37dce85346d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:06.102721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110660f-abaa-400b-b547-d37dce85346d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:06.104231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110660f-abaa-400b-b547-d37dce85346d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:06.128057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 391/770] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:06.128402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6a3ab-3203-42df-baed-87429b557777 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:06.131195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939831-ebd3-4c90-b92b-7e5907a433b3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:06.133323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939831-ebd3-4c90-b92b-7e5907a433b3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:06.134031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939831-ebd3-4c90-b92b-7e5907a433b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:06.154870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:06.159123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fd939831-ebd3-4c90-b92b-7e5907a433b3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:06.160722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fd939831-ebd3-4c90-b92b-7e5907a433b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:06.191817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:06.192477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:06.192812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:06.193141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:06.193793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:06.194148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:06.196649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:06.206573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 380/771] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Aug 30 14:31:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:06.207467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:06.286623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 392/772] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:06.288247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd939831-ebd3-4c90-b92b-7e5907a433b3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:06.322396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:06.423114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275bfc5-9154-436d-9594-8f6e1afb38d2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:06.490457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87493-fdd6-45fb-bbe4-6bae604a1500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:06.495772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87493-fdd6-45fb-bbe4-6bae604a1500 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:06.496820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87493-fdd6-45fb-bbe4-6bae604a1500 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:06.496820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87493-fdd6-45fb-bbe4-6bae604a1500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:06.498458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87493-fdd6-45fb-bbe4-6bae604a1500 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=a73f6352d0b04774bdf1ce68388cc940) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:06.498938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87493-fdd6-45fb-bbe4-6bae604a1500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:06.501640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87493-fdd6-45fb-bbe4-6bae604a1500 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:06.514314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd939831-ebd3-4c90-b92b-7e5907a433b3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:06.542415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 381/773] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:06 2022] GET /identity/v3/role_assignments?user.id=a73f6352d0b04774bdf1ce68388cc940&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:06.608935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:06.609558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ac91-6eb7-4e46-9418-a914448106ed None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:06.609843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ac91-6eb7-4e46-9418-a914448106ed None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:06.610116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ac91-6eb7-4e46-9418-a914448106ed None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:06.610999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:06.612809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:06.613023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 382/774] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:06.613833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:06.615003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:06.616199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:06.617261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1b42-5eb0-42ce-8ebb-6375e1ae8663 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:06.617542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1b42-5eb0-42ce-8ebb-6375e1ae8663 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:06.618020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1b42-5eb0-42ce-8ebb-6375e1ae8663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:06.619899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:06.628000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 393/775] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Aug 30 14:31:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:06.635110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:06.643219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5e1d1b42-5eb0-42ce-8ebb-6375e1ae8663 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:06.644451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5e1d1b42-5eb0-42ce-8ebb-6375e1ae8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:06.742975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:06.782540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 383/776] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:06.788076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:06.795609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1b42-5eb0-42ce-8ebb-6375e1ae8663 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:06.819821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4151f66-389a-407f-a9fc-09f77b204a77 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:06.874149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adad93-fa97-4bb6-9bc2-f10cc369fa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:06.876423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adad93-fa97-4bb6-9bc2-f10cc369fa57 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:06.876705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adad93-fa97-4bb6-9bc2-f10cc369fa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:06.876969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adad93-fa97-4bb6-9bc2-f10cc369fa57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:06.879006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adad93-fa97-4bb6-9bc2-f10cc369fa57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:06.881621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adad93-fa97-4bb6-9bc2-f10cc369fa57 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:06.934966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 394/777] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:31:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:06.970521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1b42-5eb0-42ce-8ebb-6375e1ae8663 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:07.036240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c51915-1f7b-4451-936a-88d067a782d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:07.037022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c51915-1f7b-4451-936a-88d067a782d7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:07.037286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c51915-1f7b-4451-936a-88d067a782d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:07.037547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c51915-1f7b-4451-936a-88d067a782d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:07.062123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c51915-1f7b-4451-936a-88d067a782d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-05c51915-1f7b-4451-936a-88d067a782d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:07.067195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:07.068212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:07.069085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:07.070236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 384/778] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:07.075115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adad93-fa97-4bb6-9bc2-f10cc369fa57 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:07.096764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c51915-1f7b-4451-936a-88d067a782d7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:07.153115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:07.262851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adad93-fa97-4bb6-9bc2-f10cc369fa57 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:07.270670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c51915-1f7b-4451-936a-88d067a782d7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:07.302828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:07.312160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:07.313005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:07.313877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:07.314746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:07.315879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:07.316645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:07.318200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:07.324298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57172b7-6e35-4410-9fa9-552bb84cde21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:07.325476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57172b7-6e35-4410-9fa9-552bb84cde21 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:07.326337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57172b7-6e35-4410-9fa9-552bb84cde21 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:07.326837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57172b7-6e35-4410-9fa9-552bb84cde21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:07.330286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 395/779] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:07.337069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:07.357920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57172b7-6e35-4410-9fa9-552bb84cde21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a57172b7-6e35-4410-9fa9-552bb84cde21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:07.365364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:07.366892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:07.368158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:07.371647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 385/780] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:07.378351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57172b7-6e35-4410-9fa9-552bb84cde21 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:07.525248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:07.543760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57172b7-6e35-4410-9fa9-552bb84cde21 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:07.590497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:07.591781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:07.592359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:07.592851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:07.593780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:07.594292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:07.595945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:07.608118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 386/781] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:07.615692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:07.711194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0363da-4ab2-49ef-84c4-57c136537283 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:07.761613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:07.762715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:07.763237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:07.763738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:07.779409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:07.781628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:07.809360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:07.810960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:07.811852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:07.811852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:07.811852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:07.815226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 396/782] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:07.823872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:07.887037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:07.922862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636356d-b360-476d-9d4f-0673b2bfeea2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:07.984404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9cc74-188d-4aad-82d9-5dfcc45552c2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:08.012647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:08.013725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:08.014203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:08.014730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:08.043389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:08.045248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:08.069339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:08.070365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:08.072115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:08.072115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:08.072115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:08.074541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 387/783] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:08.082417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:08.083551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:08.089673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:08.090819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:08.091356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:08.091851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:08.092735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:08.093926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:08.102452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:08.131641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 397/784] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:08.139399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:08.306055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b76684-87f2-4296-860f-edb3340fa8aa None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:08.342509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805892ba-dc11-43d1-989e-2ce732b86025 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:08.354974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:08.391343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:08.395207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:08.395704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:08.396117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:08.396936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:08.397666 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:08.399538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:08.432285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 388/785] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:08.436277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:08.444519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:08.445567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:08.446746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:08.447230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:08.467508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:08.469046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:08.489287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:08.492063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:08.495666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 398/786] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:31:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:08.504164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:08.512803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:08.562704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbdacb-77af-4996-96de-9f7dd3aa672d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:08.628373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:08.629033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:08.629308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:08.629575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:08.642365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:08.644114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:08.652077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe8c48-d4f6-4a63-b06d-e4a41a87ef8d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:08.679546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:08.683398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 389/787] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:08.691616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:08.697466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:08.698095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:08.698409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:08.698691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:08.699402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:08.699701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:08.701537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:08.731978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 399/788] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:31:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:08.738616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:08.792939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:08.908552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561ecba-ccaf-4b13-ae41-4253a672a7ae None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:08.965697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b5434-52e2-41b5-8ce2-571b8f5b327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:08.966750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5434-52e2-41b5-8ce2-571b8f5b327b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:08.967193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5434-52e2-41b5-8ce2-571b8f5b327b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:08.967636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5434-52e2-41b5-8ce2-571b8f5b327b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:08.983468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ccec6-254c-415a-a2ae-bc6642628771 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:08.995444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b5434-52e2-41b5-8ce2-571b8f5b327b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:08.998350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b5434-52e2-41b5-8ce2-571b8f5b327b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:09.015269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-fa1b5434-52e2-41b5-8ce2-571b8f5b327b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:09.026704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:09.028695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:09.030641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:09.030641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:09.030641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:09.031460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743be1b1-c974-4d3f-9c71-250df94e881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:09.032102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be1b1-c974-4d3f-9c71-250df94e881f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.032384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be1b1-c974-4d3f-9c71-250df94e881f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.032745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be1b1-c974-4d3f-9c71-250df94e881f None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.033498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743be1b1-c974-4d3f-9c71-250df94e881f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:09.033856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743be1b1-c974-4d3f-9c71-250df94e881f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:09.035279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 400/789] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:09.035460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743be1b1-c974-4d3f-9c71-250df94e881f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:09.038055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9af93-8ed7-49b0-972b-8a983664e4ad None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.038895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9af93-8ed7-49b0-972b-8a983664e4ad None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.039641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9af93-8ed7-49b0-972b-8a983664e4ad None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.042769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 401/790] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:09.044604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9af93-8ed7-49b0-972b-8a983664e4ad None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:09.070423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 390/791] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Aug 30 14:31:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:09.070423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aedb1-fabc-4876-85ea-d4471b0e9cf2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.070423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aedb1-fabc-4876-85ea-d4471b0e9cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.070423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aedb1-fabc-4876-85ea-d4471b0e9cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.092459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-785aedb1-fabc-4876-85ea-d4471b0e9cf2 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:09.093757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-785aedb1-fabc-4876-85ea-d4471b0e9cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:09.188994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 391/792] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:09.189980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aedb1-fabc-4876-85ea-d4471b0e9cf2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:09.214672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:09.275479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9af93-8ed7-49b0-972b-8a983664e4ad None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:09.332241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:09.333256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.333736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.334198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.335198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:09.335707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:09.337767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:09.367181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 402/793] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:09.372419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:09.412044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aedb1-fabc-4876-85ea-d4471b0e9cf2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:09.428768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:09.459684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b6cf5-10c6-4f61-a1e8-76691dc1f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:09.460955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6cf5-10c6-4f61-a1e8-76691dc1f84f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.461610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6cf5-10c6-4f61-a1e8-76691dc1f84f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.462194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b6cf5-10c6-4f61-a1e8-76691dc1f84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.477078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b6cf5-10c6-4f61-a1e8-76691dc1f84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:09.479293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b6cf5-10c6-4f61-a1e8-76691dc1f84f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c77b6cf5-10c6-4f61-a1e8-76691dc1f84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:09.516773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:09.517780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:09.518694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:09.518694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:09.518694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:09.525865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 392/794] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:09.527946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222c32-e602-4322-8aff-8839699c2bab None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.528663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222c32-e602-4322-8aff-8839699c2bab None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.529275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222c32-e602-4322-8aff-8839699c2bab None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.531788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 393/795] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:09.532890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222c32-e602-4322-8aff-8839699c2bab None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:09.534657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba56f-350b-42f2-a558-110918fe5f02 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:09.584159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8491a-a938-48d9-87b1-143c1e022a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:09.585233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8491a-a938-48d9-87b1-143c1e022a4c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.585526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8491a-a938-48d9-87b1-143c1e022a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.585799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8491a-a938-48d9-87b1-143c1e022a4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.588845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:09.600157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8491a-a938-48d9-87b1-143c1e022a4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:09.601673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8491a-a938-48d9-87b1-143c1e022a4c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-95a8491a-a938-48d9-87b1-143c1e022a4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:09.620576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:09.621886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:09.622851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:09.622851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:09.622851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:09.622851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:09.622851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:09.622851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:09.622851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:09.622851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:09.626488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 403/796] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:09.628555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ba82e-18fa-44b3-af64-3306ac58b071 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.630684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ba82e-18fa-44b3-af64-3306ac58b071 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.631088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ba82e-18fa-44b3-af64-3306ac58b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.664115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3b9ba82e-18fa-44b3-af64-3306ac58b071 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:09.665463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3b9ba82e-18fa-44b3-af64-3306ac58b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:09.714506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222c32-e602-4322-8aff-8839699c2bab None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:09.766887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 404/797] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:09.768275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ba82e-18fa-44b3-af64-3306ac58b071 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:09.784631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:09.785813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:09.786298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:09.787025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:09.788273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:09.788952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:09.792147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:09.817598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 394/798] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:09.819683 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:09.868858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:09.988236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ba82e-18fa-44b3-af64-3306ac58b071 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:10.025304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606dace-685f-40cd-a1b5-fd4cfe0a311d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:10.044616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:10.065757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:10.067000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.067498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.068134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.069439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:10.069994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:10.072695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:10.075825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa661f2-7cd1-4e25-a4de-9be6ccfe67f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:10.077225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa661f2-7cd1-4e25-a4de-9be6ccfe67f8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.077703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa661f2-7cd1-4e25-a4de-9be6ccfe67f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.078167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa661f2-7cd1-4e25-a4de-9be6ccfe67f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.079257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa661f2-7cd1-4e25-a4de-9be6ccfe67f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:10.081841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa661f2-7cd1-4e25-a4de-9be6ccfe67f8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:10.102588 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 405/799] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-caa661f2-7cd1-4e25-a4de-9be6ccfe67f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:10.102810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:10.104115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 14:31:10.105125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:10.106010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:10.106183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 395/800] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:09 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:10.106183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bb89-bbb2-4727-9214-de9d18783624 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.106183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bb89-bbb2-4727-9214-de9d18783624 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.106183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bb89-bbb2-4727-9214-de9d18783624 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.110563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 396/801] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:10.111961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38bb89-bbb2-4727-9214-de9d18783624 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:10.234447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1ecd5-a073-492a-a013-f91849abcc2b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:10.246163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:10.267865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38bb89-bbb2-4727-9214-de9d18783624 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:10.288570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:10.289756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.290324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.290832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.304633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:10.307690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:10.318078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9302b9-eedd-4a54-b37c-e51768706f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:10.319045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9302b9-eedd-4a54-b37c-e51768706f96 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.319474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9302b9-eedd-4a54-b37c-e51768706f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.319867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9302b9-eedd-4a54-b37c-e51768706f96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:10.325310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:10.327568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:10.329280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 406/802] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:10.331684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:10.339410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9302b9-eedd-4a54-b37c-e51768706f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-aa9302b9-eedd-4a54-b37c-e51768706f96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:10.345879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:10.347881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 397/803] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:31:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:10.349528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9302b9-eedd-4a54-b37c-e51768706f96 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:10.407940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:10.480717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861cfd4-436a-4bc0-b3f0-748f4a492b55 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:10.488301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9302b9-eedd-4a54-b37c-e51768706f96 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:10.525841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf636-0f22-424b-b7bc-5326da22b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:10.526436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf636-0f22-424b-b7bc-5326da22b4f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.526722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf636-0f22-424b-b7bc-5326da22b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.526994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf636-0f22-424b-b7bc-5326da22b4f9 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/906464ed50294dc481c4d1d570a5195b/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.528960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acf636-0f22-424b-b7bc-5326da22b4f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=906464ed50294dc481c4d1d570a5195b, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:10.529407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3921c01-e685-4bc8-a9bd-5198cd457f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:10.530150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921c01-e685-4bc8-a9bd-5198cd457f76 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.530454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acf636-0f22-424b-b7bc-5326da22b4f9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:10.530618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921c01-e685-4bc8-a9bd-5198cd457f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.530953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921c01-e685-4bc8-a9bd-5198cd457f76 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.531681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3921c01-e685-4bc8-a9bd-5198cd457f76 None admin] RBAC: Adding query filter params (name=network) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:10.532078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3921c01-e685-4bc8-a9bd-5198cd457f76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:10.534168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3921c01-e685-4bc8-a9bd-5198cd457f76 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:10.540854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 398/804] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:10.542202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356379c-9007-40e0-9b17-a009bc825d7d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.542591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356379c-9007-40e0-9b17-a009bc825d7d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.542863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356379c-9007-40e0-9b17-a009bc825d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.546505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 407/805] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:31:10 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/906464ed50294dc481c4d1d570a5195b/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:31:10.547955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf636-0f22-424b-b7bc-5326da22b4f9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:10.576581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c356379c-9007-40e0-9b17-a009bc825d7d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:10.578498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c356379c-9007-40e0-9b17-a009bc825d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:10.584766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:10.704544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 399/806] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:10.705875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356379c-9007-40e0-9b17-a009bc825d7d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:10.753434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acf636-0f22-424b-b7bc-5326da22b4f9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:10.759485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:10.807425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:10.809075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.809547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.810136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.811158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:10.811651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:10.814794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:10.832559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 408/807] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:10.833877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:10.858956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356379c-9007-40e0-9b17-a009bc825d7d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:10.904708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:10.905338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:10.905668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:10.905944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:10.907209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:10.907517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:10.908987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:10.921033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 400/808] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:31:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:10.926673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:10.940594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:11.009950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bac6-b1c8-4505-a4ba-3c6288a98bc4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:11.066747 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646577f1-c961-496a-b43d-1bdcebac6889 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:11.079132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:11.080094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:11.080554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:11.081054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:11.081993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:11.082518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:11.084217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:11.091711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 409/809] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:11.092956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:11.144113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:11.151871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c689af-0646-433c-8f8a-ecaeea8ebea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:11.152987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c689af-0646-433c-8f8a-ecaeea8ebea1 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:11.153457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c689af-0646-433c-8f8a-ecaeea8ebea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:11.153919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c689af-0646-433c-8f8a-ecaeea8ebea1 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/b4639f179d4b4bb7b1fae6a8cf28d919/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:11.157941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c689af-0646-433c-8f8a-ecaeea8ebea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=b4639f179d4b4bb7b1fae6a8cf28d919, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:11.160874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c689af-0646-433c-8f8a-ecaeea8ebea1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:11.194408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 401/810] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:31:10 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/b4639f179d4b4bb7b1fae6a8cf28d919/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:31:11.194408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c689af-0646-433c-8f8a-ecaeea8ebea1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:11.263162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81096378-29f3-4920-892b-5cd979ff7cc3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:11.309443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:11.338574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:11.339778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:11.340389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:11.341041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:11.361700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c689af-0646-433c-8f8a-ecaeea8ebea1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:11.362090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:11.365865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:11.394932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:11.395934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:11.396808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:11.396808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:11.396808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:11.397082 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 410/811] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:11.398297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:11.415740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:11.416358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:11.416640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:11.416984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:11.417982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:11.419824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:11.436550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:11.437614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:11.438570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 402/812] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:11.439346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:11.532345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:11.560626 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b922c-4682-46b9-9ccf-62c5e212f5e1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:11.563276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a5fac-a083-46cf-a517-21e3330518e0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:11.596358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:11.610761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:11.611394 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:11.611669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:11.611937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:11.612625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:11.612885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:11.614408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:11.615399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cf824-a2df-42f4-9cf9-29994d28011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:11.618234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf824-a2df-42f4-9cf9-29994d28011e None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:11.619125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf824-a2df-42f4-9cf9-29994d28011e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:11.619903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf824-a2df-42f4-9cf9-29994d28011e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:11.621378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cf824-a2df-42f4-9cf9-29994d28011e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:11.625885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cf824-a2df-42f4-9cf9-29994d28011e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:11.630485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 403/813] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:11.632439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:11.672814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 411/814] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:31:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:11.674813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cf824-a2df-42f4-9cf9-29994d28011e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:11.848559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313c997-8a9f-4297-99d8-c0fb4f7ff022 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:11.936678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cf824-a2df-42f4-9cf9-29994d28011e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:11.952955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:11.953930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:11.954416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:11.954938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:11.956053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:11.956566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:11.958857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:11.979274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 404/815] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:11.986932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:11.989899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:12.001325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:12.002088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:12.002456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:12.002837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:12.014885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:12.016803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:12.035167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:12.036992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:12.038817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 412/816] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:31:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:12.048522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:12.092742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:12.235027 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5f255-7b66-4d85-adc0-ad62547d08c3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:12.235490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63e7d-abd0-402f-a632-80342ab69d24 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:12.294168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:12.297228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:12.297228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:12.297228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:12.297228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:12.297228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:12.297903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:12.326428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:12.326658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 413/817] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Aug 30 14:31:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:12.327282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:12.327560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:12.327828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:12.328503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:12.328801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:12.330236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:12.332444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:12.340707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 405/818] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:12.394420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:12.455281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355da8-e2a3-40b2-9d93-a526a148b0a9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:12.496996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:12.497615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:12.497884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:12.498145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:12.510077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:12.511792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:12.528639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:12.530344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:12.532116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:12.532116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:12.532116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:12.532116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 414/819] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:12.539783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:12.759238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424db8-ee46-45e2-9c5e-abc1d768fc9e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:12.789458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:12.837155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:12.837664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:12.838142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:12.838641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:12.839841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:12.840364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:12.842923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:12.866136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 406/820] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:12.874871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:13.071029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a0903-c071-42ee-be68-0e73a79145a7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:13.073893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:13.129999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:13.130928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:13.131383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:13.131835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:13.144739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:13.147395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:13.170510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:13.172199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:13.173385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 415/821] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:13.183952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:13.369551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fec832-819b-4a8e-9ee3-ac255a644d85 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:13.429439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8224dad-0cbc-46cd-b677-65542e3e9986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:13.431215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224dad-0cbc-46cd-b677-65542e3e9986 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:13.431692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224dad-0cbc-46cd-b677-65542e3e9986 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:13.432174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224dad-0cbc-46cd-b677-65542e3e9986 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:13.433459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8224dad-0cbc-46cd-b677-65542e3e9986 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:13.433968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8224dad-0cbc-46cd-b677-65542e3e9986 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:13.436695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8224dad-0cbc-46cd-b677-65542e3e9986 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:13.461370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 407/822] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:13.469835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:13.515108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c3e3-3570-4e2b-bfb8-bc2a68b0cedb None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:13.515535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c3e3-3570-4e2b-bfb8-bc2a68b0cedb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:13.515928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076c3e3-3570-4e2b-bfb8-bc2a68b0cedb None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:13.518560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 408/823] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:13.519738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e026-aad0-4a02-960f-679711aceeb0 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:13.520012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e026-aad0-4a02-960f-679711aceeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:13.520277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e026-aad0-4a02-960f-679711aceeb0 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:13.521817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 409/824] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:13.527257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972b427-d9c4-4ba1-8c55-d0ebfddadaf3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:13.527754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972b427-d9c4-4ba1-8c55-d0ebfddadaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:13.528275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972b427-d9c4-4ba1-8c55-d0ebfddadaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:13.561175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6972b427-d9c4-4ba1-8c55-d0ebfddadaf3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:13.563326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6972b427-d9c4-4ba1-8c55-d0ebfddadaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:13.624616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:13.675564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d19d4-63b0-4dda-9cce-139df712ac8b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:13.686927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 410/825] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:13.690144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618620c-be2b-4e96-8e32-c17fb0fd8787 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:13.691294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618620c-be2b-4e96-8e32-c17fb0fd8787 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:13.692317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618620c-be2b-4e96-8e32-c17fb0fd8787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:13.721761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4b49-419a-4477-943d-7eb3c8d21388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:13.722633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4b49-419a-4477-943d-7eb3c8d21388 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:13.723012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4b49-419a-4477-943d-7eb3c8d21388 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:13.723412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4b49-419a-4477-943d-7eb3c8d21388 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/a73f6352d0b04774bdf1ce68388cc940/roles/b02fcaf15370497abe5973b37a3a2a74` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:13.736583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b618620c-be2b-4e96-8e32-c17fb0fd8787 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:13.739464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b618620c-be2b-4e96-8e32-c17fb0fd8787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:13.743706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f4b49-419a-4477-943d-7eb3c8d21388 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=a73f6352d0b04774bdf1ce68388cc940, role_id=b02fcaf15370497abe5973b37a3a2a74)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:13.745361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f4b49-419a-4477-943d-7eb3c8d21388 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:13.770320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 416/826] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:31:13 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/a73f6352d0b04774bdf1ce68388cc940/roles/b02fcaf15370497abe5973b37a3a2a74 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:31:13.887226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 411/827] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:14.032431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4b49-419a-4477-943d-7eb3c8d21388 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:14.051148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:14.223732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4b49-419a-4477-943d-7eb3c8d21388 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:14.249051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618620c-be2b-4e96-8e32-c17fb0fd8787 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:14.315554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b02909-9e66-4e2d-bab7-1eae62bc147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:14.317369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02909-9e66-4e2d-bab7-1eae62bc147b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:14.318448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02909-9e66-4e2d-bab7-1eae62bc147b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:14.319123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02909-9e66-4e2d-bab7-1eae62bc147b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:14.349780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b02909-9e66-4e2d-bab7-1eae62bc147b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-86b02909-9e66-4e2d-bab7-1eae62bc147b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:14.360972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:14.362837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:14.364472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:14.368676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 417/828] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:14.370714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:14.374165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b02909-9e66-4e2d-bab7-1eae62bc147b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:14.384059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618620c-be2b-4e96-8e32-c17fb0fd8787 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:14.433306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85f6d-7b28-48fe-9712-f6fcc8aad462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:14.434426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85f6d-7b28-48fe-9712-f6fcc8aad462 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:14.434813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85f6d-7b28-48fe-9712-f6fcc8aad462 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:14.435309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85f6d-7b28-48fe-9712-f6fcc8aad462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:14.453274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb85f6d-7b28-48fe-9712-f6fcc8aad462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-8cb85f6d-7b28-48fe-9712-f6fcc8aad462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:14.458942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:14.460728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:14.462431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:14.465492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 412/829] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:14.466885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85f6d-7b28-48fe-9712-f6fcc8aad462 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:14.537628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:14.589750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b02909-9e66-4e2d-bab7-1eae62bc147b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:14.635426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85f6d-7b28-48fe-9712-f6fcc8aad462 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:14.642867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:14.643640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:14.644016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:14.644384 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:14.645166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:14.645560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:14.647137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:14.661246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 418/830] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:14.663493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:14.702714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:14.704025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:14.704337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:14.704974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:14.706319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:14.707246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:14.710967 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:14.734257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 413/831] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:14.736043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:14.752923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:14.798095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e84778-8030-439f-9240-9a8c466c7c78 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:14.838720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:14.839468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:14.840124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:14.840402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:14.843258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:14.857345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:14.858800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435dc0-24fc-4400-8a82-16fcd57902ad None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:14.859678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:14.878704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:14.879799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:14.880654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:14.880654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:14.880654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:14.886371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 419/832] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:14.887523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:14.900202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:14.901243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:14.901734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:14.902194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:14.914425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:14.916300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:14.931778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:14.932798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:14.933685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:14.933685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:14.933685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:14.940425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 414/833] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:14.942058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:15.011318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:15.017624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d4e2-165e-49b5-91a1-c160b04e596b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:15.054127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2bc1-9b78-4958-8e21-bbe89ca66fa3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:15.058191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:15.058191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.058526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.058801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.059571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:15.059878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:15.061375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:15.080817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 420/834] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:15.081954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:15.093953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:15.094856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.095276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.095680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.096489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:15.096925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:15.098559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:15.116893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 415/835] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:15.118691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:15.136648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:15.201446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78efa67-421a-4006-ba2d-70c715b5e2f5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:15.235043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725eb1f-eb17-4d56-bb7d-61f0da8d8e54 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:15.259139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:15.260231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.260714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.261153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.262420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:15.274818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:15.275019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666992a-45ee-4cfe-a748-8936f9aa3ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:15.275650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666992a-45ee-4cfe-a748-8936f9aa3ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.275926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666992a-45ee-4cfe-a748-8936f9aa3ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.276196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666992a-45ee-4cfe-a748-8936f9aa3ec8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.277518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:15.284427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666992a-45ee-4cfe-a748-8936f9aa3ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:15.285876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666992a-45ee-4cfe-a748-8936f9aa3ec8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7666992a-45ee-4cfe-a748-8936f9aa3ec8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:15.298431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:15.299469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:31:15.307208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:15.307748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:15.308627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 14:31:15.309546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:15.310936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 416/836] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:31:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:15.310936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2025d3-17d4-4140-9d95-dabaa9a8362e None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.311233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 421/837] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:15.311382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2025d3-17d4-4140-9d95-dabaa9a8362e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.311382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2025d3-17d4-4140-9d95-dabaa9a8362e None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.311692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:15.311847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 417/838] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:15.311847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2025d3-17d4-4140-9d95-dabaa9a8362e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:15.439672 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2025d3-17d4-4140-9d95-dabaa9a8362e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:15.481438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f758b0-4da1-43d8-a289-fd42cabb376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:15.482068 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f758b0-4da1-43d8-a289-fd42cabb376f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.482300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f758b0-4da1-43d8-a289-fd42cabb376f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.482703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f758b0-4da1-43d8-a289-fd42cabb376f None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.483356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f758b0-4da1-43d8-a289-fd42cabb376f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:15.483663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f758b0-4da1-43d8-a289-fd42cabb376f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:15.485141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f758b0-4da1-43d8-a289-fd42cabb376f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:15.491569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2049a22-a410-4223-bbe9-93fa831f9f57 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:15.503615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:15.512879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 418/839] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Aug 30 14:31:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:15.514367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3dbc5-504c-4cdd-a09a-97a2f376c0dd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.514693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3dbc5-504c-4cdd-a09a-97a2f376c0dd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.515149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3dbc5-504c-4cdd-a09a-97a2f376c0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.539147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d4e3dbc5-504c-4cdd-a09a-97a2f376c0dd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:15.541242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d4e3dbc5-504c-4cdd-a09a-97a2f376c0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:15.548637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:15.549362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.549708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.550055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.550983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:15.551395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:15.552952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:15.580532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 422/840] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:31:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:15.580532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:15.599506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:15.640599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 419/841] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:15.641610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3dbc5-504c-4cdd-a09a-97a2f376c0dd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:15.741186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc895e-dfe2-49f5-917a-56faf39db8f7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:15.811972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3dbc5-504c-4cdd-a09a-97a2f376c0dd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:15.812744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaeff6-a9e7-42f1-ab1b-37dbf9cdbe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:15.813684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaeff6-a9e7-42f1-ab1b-37dbf9cdbe49 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.814239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaeff6-a9e7-42f1-ab1b-37dbf9cdbe49 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.814825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaeff6-a9e7-42f1-ab1b-37dbf9cdbe49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.857157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49b41-6654-4264-b891-701ff9b299b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:15.857675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49b41-6654-4264-b891-701ff9b299b0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:15.857959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49b41-6654-4264-b891-701ff9b299b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:15.858209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49b41-6654-4264-b891-701ff9b299b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:15.864752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:15.911103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:15.922777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baaeff6-a9e7-42f1-ab1b-37dbf9cdbe49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:15.924269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baaeff6-a9e7-42f1-ab1b-37dbf9cdbe49 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:15.951991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49b41-6654-4264-b891-701ff9b299b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:15.953453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49b41-6654-4264-b891-701ff9b299b0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:16.049895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 423/842] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:31:16.051327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15cbe5-9af8-4d0b-8244-a2af19536d26 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.051607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15cbe5-9af8-4d0b-8244-a2af19536d26 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.051912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15cbe5-9af8-4d0b-8244-a2af19536d26 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.053250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 424/843] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:16.054043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15cbe5-9af8-4d0b-8244-a2af19536d26 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:16.099886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 420/844] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:31:16.100808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49b41-6654-4264-b891-701ff9b299b0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:16.149152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:16.187843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:16.210446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15cbe5-9af8-4d0b-8244-a2af19536d26 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:16.237217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49b41-6654-4264-b891-701ff9b299b0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:16.249310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7669-d9e9-4bae-870d-d8b35c935aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:16.249927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7669-d9e9-4bae-870d-d8b35c935aeb None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.250199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7669-d9e9-4bae-870d-d8b35c935aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.250495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7669-d9e9-4bae-870d-d8b35c935aeb None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.251160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba7669-d9e9-4bae-870d-d8b35c935aeb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:16.252579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba7669-d9e9-4bae-870d-d8b35c935aeb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:16.269689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 425/845] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:31:16 2022] POST /identity/v3/services => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:16.271032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ee3a-7fd6-4c4e-b532-0e264d9a79c6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.271332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ee3a-7fd6-4c4e-b532-0e264d9a79c6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.271568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117ee3a-7fd6-4c4e-b532-0e264d9a79c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.300876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6117ee3a-7fd6-4c4e-b532-0e264d9a79c6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:16.304348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6117ee3a-7fd6-4c4e-b532-0e264d9a79c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:16.307006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:16.308466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.308796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.309208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.323062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:16.324656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:16.342759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:16.343805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:16.344715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:16.344715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:16.344715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:16.349130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 421/846] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:16.350160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:16.419659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 426/847] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:16.420894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ee3a-7fd6-4c4e-b532-0e264d9a79c6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:16.505942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53705a3c-59f6-497e-b016-72e9f29036f6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:16.520681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:16.536173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:16.563154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:16.564171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.564518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.564864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.581799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:16.584196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:16.587122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117ee3a-7fd6-4c4e-b532-0e264d9a79c6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:16.610066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:16.611126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:16.612018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:16.612018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:16.612018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:16.612636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 422/848] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:16.618531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:16.636585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:16.637765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.638198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.638840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.640080 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:16.640716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:16.642635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:16.659511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 427/849] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:16.665954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:16.742166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4160333-3015-4298-b4cd-d2a7a91e5508 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:16.784462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:16.785481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.785756 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.786088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.786783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:16.787084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:16.788533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:16.806614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 423/850] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:16.806614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:16.842427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:16.856492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58e62-d2d5-4fbb-9f98-5c84c185de9c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:16.879902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:16.917177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:16.918285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.918782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.919217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.928674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d4244-2656-4eac-be3f-8509fa9158a3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:16.932234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:16.935168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:16.958805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:16.959778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:16.960844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:16.960844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:16.960844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:16.960844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:16.960844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:16.960844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:16.960844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:16.960844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:16.967194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 428/851] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:16.968592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:16.972108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826caf4-71ac-46e8-8177-429fe103aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:16.973086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826caf4-71ac-46e8-8177-429fe103aa6a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:16.973531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826caf4-71ac-46e8-8177-429fe103aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:16.974004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826caf4-71ac-46e8-8177-429fe103aa6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:16.992759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826caf4-71ac-46e8-8177-429fe103aa6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-5826caf4-71ac-46e8-8177-429fe103aa6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:17.003875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:17.005682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:31:17.007489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:17.012092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 424/852] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:31:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:17.013785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826caf4-71ac-46e8-8177-429fe103aa6a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:17.091698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72be3d-ba05-4ea6-b0ef-85c0c2504d44 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:17.130689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:17.131360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:17.131613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:17.131885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:17.140956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:17.142525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:17.156261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:17.158205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:17.160085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:17.160085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:17.160085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:17.160085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:17.160085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:17.160085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:17.160085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:17.160085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:17.162905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 429/853] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:17.163368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:17.201868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:17.206407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:17.219071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826caf4-71ac-46e8-8177-429fe103aa6a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:17.282053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:17.283131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:17.283596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:17.284070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:17.285368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:17.285885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:17.288567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:17.299239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde18b57-7834-4352-857a-8623b1d1f5e2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:17.317717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 425/854] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:17.317717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:17.353031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:17.359010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:17.359373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:17.359640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:17.360302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:17.360685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:17.362044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:17.378840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 430/855] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:31:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:17.378840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:17.480738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6cbb6-bf8b-4fdd-b44d-b60ce3147994 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:17.535565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:17.536980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:17.537743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:17.538449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:17.539534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:17.540312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:17.541982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:17.556477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 426/856] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:17.559552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:17.563993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:17.574229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b652-94ee-4999-963c-de99c4236e88 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:17.587310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:17.624887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:17.625843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:17.626272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:17.626739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:17.627954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=fabb84470909411f80adffac902dea45, user.id=b4639f179d4b4bb7b1fae6a8cf28d919) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:17.628448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:17.630973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:17.650408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 431/857] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:17 2022] GET /identity/v3/role_assignments?user.id=b4639f179d4b4bb7b1fae6a8cf28d919&scope.project.id=fabb84470909411f80adffac902dea45&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:17.650408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:17.776737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44cdcb-b97a-4d03-8420-c478c981336f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:17.840616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:17.841796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:17.842326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:17.842891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:17.861513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec6bf3-5ce4-4074-bd29-0726a566a73c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:17.862434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:17.865164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:17.903979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:17.905243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:17.906582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:17.906582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:17.906582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:17.906582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 427/858] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:17.915347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:17.931233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:17.932201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:17.932635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:17.933053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:17.934308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=fabb84470909411f80adffac902dea45, user.id=906464ed50294dc481c4d1d570a5195b) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:17.934841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:17.937276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:17.950052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 432/859] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:17 2022] GET /identity/v3/role_assignments?user.id=906464ed50294dc481c4d1d570a5195b&scope.project.id=fabb84470909411f80adffac902dea45&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:18.041656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:18.098431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14631f9b-a412-4114-9718-24093e41cc09 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:18.160714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3a112-9ddf-4135-b25d-a36f40e10933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:18.161346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a112-9ddf-4135-b25d-a36f40e10933 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:18.162406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a112-9ddf-4135-b25d-a36f40e10933 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:18.162406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a112-9ddf-4135-b25d-a36f40e10933 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:18.162702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3a112-9ddf-4135-b25d-a36f40e10933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:18.162861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3a112-9ddf-4135-b25d-a36f40e10933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:18.164426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3a112-9ddf-4135-b25d-a36f40e10933 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:18.183419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 428/860] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:18.184832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:18.223187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:18.347409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7e0f1-11a2-4487-9e5b-c6be64ba6e45 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:18.387407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c98c17-e534-447b-9595-288f2d38fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:18.388320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98c17-e534-447b-9595-288f2d38fe54 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:18.388744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98c17-e534-447b-9595-288f2d38fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:18.389159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98c17-e534-447b-9595-288f2d38fe54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:18.398130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c98c17-e534-447b-9595-288f2d38fe54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:18.399966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c98c17-e534-447b-9595-288f2d38fe54 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c0c98c17-e534-447b-9595-288f2d38fe54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:18.412894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:18.414089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:18.415268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:18.415865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db188-c0ac-4ad7-95aa-501f00c078c4 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:18.415865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db188-c0ac-4ad7-95aa-501f00c078c4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:18.415865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646db188-c0ac-4ad7-95aa-501f00c078c4 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:18.418077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 433/862] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:31:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:18.426398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 429/862] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:18.426591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ed30-7d46-4630-8c02-7d47ad26f2d1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:18.426591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ed30-7d46-4630-8c02-7d47ad26f2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:18.426591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ed30-7d46-4630-8c02-7d47ad26f2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:18.426852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646db188-c0ac-4ad7-95aa-501f00c078c4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:18.449707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6958ed30-7d46-4630-8c02-7d47ad26f2d1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:18.452878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6958ed30-7d46-4630-8c02-7d47ad26f2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:18.554106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646db188-c0ac-4ad7-95aa-501f00c078c4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:18.570956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 434/863] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:18.603272 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:18.615668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:18.616411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:18.616688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:18.616956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:18.617782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:18.618151 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:18.619914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:18.642355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 430/864] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Aug 30 14:31:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:18.647922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958ed30-7d46-4630-8c02-7d47ad26f2d1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:18.683109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:18.761516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958ed30-7d46-4630-8c02-7d47ad26f2d1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:18.799763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a0cde-0f61-4e6d-b5cb-7448fea934c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:18.800407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a0cde-0f61-4e6d-b5cb-7448fea934c5 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:18.800692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a0cde-0f61-4e6d-b5cb-7448fea934c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:18.800964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a0cde-0f61-4e6d-b5cb-7448fea934c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:18.882399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a0cde-0f61-4e6d-b5cb-7448fea934c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:18.884594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a0cde-0f61-4e6d-b5cb-7448fea934c5 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:18.915692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:18.997421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 435/865] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:18 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:31:19.003044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:19.046301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a0cde-0f61-4e6d-b5cb-7448fea934c5 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:19.130340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c20bf-6689-4508-b3a8-0f50f07c8a38 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:19.168657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:19.169202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.169485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.169729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.181032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:19.182547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:19.198563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:19.201139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:19.203225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:19.203225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:19.203225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:19.203225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 431/866] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:19.205749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:19.242775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:19.271973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a0cde-0f61-4e6d-b5cb-7448fea934c5 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:19.304020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:19.322399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cb23c-52da-4874-a1c9-7071cc1536af None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:19.348988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:19.351151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.351995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.352772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.354179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:19.357439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:19.361121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:19.361820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.362153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.362508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.363221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:19.363597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:19.365054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:19.373932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:19.375114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:19.375986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:19.378743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 432/867] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:19.379553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 436/868] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:19.385644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:19.386598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:19.485613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:19.493152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1de080-7c2b-4147-aa3f-14a77d9296e2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:19.534553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:19.535325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.535657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.535986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.543700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:19.545268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:19.557976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:19.560182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:19.562301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 433/869] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:19.565665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:19.603556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42dfe4-6ef9-41a6-91d5-ba40dd7a5099 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:19.680164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:19.681835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.682611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.683398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.684916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:19.685761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:19.688586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:19.704147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 437/870] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:19.709344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:19.715320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af403f-674d-41ce-b96e-c7d732b17255 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:19.754369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:19.755035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.755315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.755580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.756316 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:19.756680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:19.758325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:19.773194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 434/871] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:19.779497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:19.785936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:19.800223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:19.895500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2bbd2-1cb8-487b-8868-05559ff478bd None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:19.901139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cd520-3a26-4b37-a294-90c1faf2f8de None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:19.934656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407120a-d543-459e-ad41-2dbd9247a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:19.935144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407120a-d543-459e-ad41-2dbd9247a519 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.935391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407120a-d543-459e-ad41-2dbd9247a519 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.935657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407120a-d543-459e-ad41-2dbd9247a519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.936387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407120a-d543-459e-ad41-2dbd9247a519 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=a73f6352d0b04774bdf1ce68388cc940) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:19.937048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407120a-d543-459e-ad41-2dbd9247a519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:19.938129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407120a-d543-459e-ad41-2dbd9247a519 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:19.954674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 435/872] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:19 2022] GET /identity/v3/role_assignments?user.id=a73f6352d0b04774bdf1ce68388cc940&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:19.954674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90360-db1d-4969-9dc2-dd015eb79f72 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.954674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90360-db1d-4969-9dc2-dd015eb79f72 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.954674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90360-db1d-4969-9dc2-dd015eb79f72 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.954674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 436/873] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:19.957093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c3b2-41aa-45fa-8375-55c87341f233 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.957832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c3b2-41aa-45fa-8375-55c87341f233 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.957832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c3b2-41aa-45fa-8375-55c87341f233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.978395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:19.978620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9e33c3b2-41aa-45fa-8375-55c87341f233 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:19.979394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:19.979794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9e33c3b2-41aa-45fa-8375-55c87341f233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:19.979897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:19.980355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:19.981508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:19.982088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:19.984505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:19.999145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 438/874] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:20.004278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:20.070927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 437/875] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:20.143183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac490bdd-9985-4b17-bcbb-337f198ee82e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:20.152832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:20.189104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c3241-459b-4e72-98cb-2d25c0289e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:20.189895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c3241-459b-4e72-98cb-2d25c0289e1a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:20.190364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c3241-459b-4e72-98cb-2d25c0289e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:20.190699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c3241-459b-4e72-98cb-2d25c0289e1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:20.191590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c3241-459b-4e72-98cb-2d25c0289e1a None admin] RBAC: Adding query filter params (interface=public, service_id=5e60de341d174446812a8a0632ce30b2, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:20.191987 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c3241-459b-4e72-98cb-2d25c0289e1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:20.193490 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c3241-459b-4e72-98cb-2d25c0289e1a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:20.201628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 439/876] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Aug 30 14:31:20 2022] GET /identity/v3/endpoints?service_id=5e60de341d174446812a8a0632ce30b2&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:20.207746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33c3b2-41aa-45fa-8375-55c87341f233 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:20.220300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:20.225136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90914b3-989e-4798-a278-732207b5407c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:20.225136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90914b3-989e-4798-a278-732207b5407c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:20.225464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90914b3-989e-4798-a278-732207b5407c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:20.227158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 440/877] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:20.236465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2bc8-a6b6-4360-8e35-192e4e66c999 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:20.236822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2bc8-a6b6-4360-8e35-192e4e66c999 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:20.237076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2bc8-a6b6-4360-8e35-192e4e66c999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:20.258803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4f0c2bc8-a6b6-4360-8e35-192e4e66c999 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:20.259338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4f0c2bc8-a6b6-4360-8e35-192e4e66c999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:20.350764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33c3b2-41aa-45fa-8375-55c87341f233 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:20.374642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 441/878] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:20.377115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2bc8-a6b6-4360-8e35-192e4e66c999 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:20.401969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdbd51-20f4-4356-850c-8f1edbbd2f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:20.402958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdbd51-20f4-4356-850c-8f1edbbd2f69 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:20.403344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdbd51-20f4-4356-850c-8f1edbbd2f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:20.403884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdbd51-20f4-4356-850c-8f1edbbd2f69 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:20.404981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdbd51-20f4-4356-850c-8f1edbbd2f69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:20.407722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdbd51-20f4-4356-850c-8f1edbbd2f69 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:20.419013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 438/879] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:31:20 2022] GET /identity/v3/services => generated 1011 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:31:20.547109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:20.551288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2bc8-a6b6-4360-8e35-192e4e66c999 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:20.592681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:20.593706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:20.594229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:20.594543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:20.595141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:20.596566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:20.606801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:20.608545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:20.610016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 442/880] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:20.614351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdbd51-20f4-4356-850c-8f1edbbd2f69 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:20.659869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:20.737887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:20.788771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdbd51-20f4-4356-850c-8f1edbbd2f69 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:20.797537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2f2cf-d72b-4a07-ab6d-613d9999aa7d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:20.842965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:20.843603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:20.843985 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:20.844264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:20.845209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:20.845725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:20.847237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:20.847991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:20.848117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:20.848443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:20.848809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:20.849510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:20.851043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:20.858843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 439/881] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:20.861146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:20.862290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:20.864249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 443/882] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Aug 30 14:31:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:20.866109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:20.872824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:20.930843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:21.036473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311430aa-3538-4c92-b0c5-f4ced04903de None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:21.052174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49898c53-c484-4196-8acf-a536056bf10a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:21.089238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:21.090610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:21.091149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:21.091623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:21.092833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:21.093363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:21.096097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:21.105873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 444/883] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:21.114596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4a459-0cc6-4aca-8fcf-44eea810b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:21.115134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a459-0cc6-4aca-8fcf-44eea810b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:21.115411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a459-0cc6-4aca-8fcf-44eea810b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:21.115683 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a459-0cc6-4aca-8fcf-44eea810b5f3 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:21.116341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a459-0cc6-4aca-8fcf-44eea810b5f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:21.116637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a459-0cc6-4aca-8fcf-44eea810b5f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:21.117305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:21.118585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a459-0cc6-4aca-8fcf-44eea810b5f3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:21.121242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:21.127535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 440/884] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:21.288994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:21.300004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec9501-6596-41a8-af93-cfde390d3cda None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:21.337823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65546-87c7-4e63-9115-5dcdfa77aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:21.338495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65546-87c7-4e63-9115-5dcdfa77aeac None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:21.338794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65546-87c7-4e63-9115-5dcdfa77aeac None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:21.339048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65546-87c7-4e63-9115-5dcdfa77aeac None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:21.339645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb65546-87c7-4e63-9115-5dcdfa77aeac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:21.339946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb65546-87c7-4e63-9115-5dcdfa77aeac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:21.341366 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb65546-87c7-4e63-9115-5dcdfa77aeac None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:21.346882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 445/885] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:22.498620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18cd5c-7fbc-4d99-b814-34207ba9654c None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:22.499510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18cd5c-7fbc-4d99-b814-34207ba9654c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:22.499917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18cd5c-7fbc-4d99-b814-34207ba9654c None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:22.501440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 441/886] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:22.509769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766b23c-b0c4-4a54-82e5-ec3a39acd48c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:22.510297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766b23c-b0c4-4a54-82e5-ec3a39acd48c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:22.510559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766b23c-b0c4-4a54-82e5-ec3a39acd48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:22.530585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8766b23c-b0c4-4a54-82e5-ec3a39acd48c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:22.531836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8766b23c-b0c4-4a54-82e5-ec3a39acd48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:22.606122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 446/887] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:22.874749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18cd5c-7fbc-4d99-b814-34207ba9654c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:22.996601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18cd5c-7fbc-4d99-b814-34207ba9654c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:23.042614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0200-df72-45a4-a3b2-1b8d077503b4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.043104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0200-df72-45a4-a3b2-1b8d077503b4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.043583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0200-df72-45a4-a3b2-1b8d077503b4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.044137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:23.045056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.045572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.046056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.046936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:23.048639 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:23.053244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 447/888] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:23.055718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099795c0-8359-41f9-9998-0b7531c58f5a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.056194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099795c0-8359-41f9-9998-0b7531c58f5a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.056664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099795c0-8359-41f9-9998-0b7531c58f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:23.061041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:23.062115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 14:31:23.063059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:23.065878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 442/889] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:23.071199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:23.093292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-099795c0-8359-41f9-9998-0b7531c58f5a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:23.095028 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-099795c0-8359-41f9-9998-0b7531c58f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:23.185287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 448/890] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:23.203012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:23.236720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88ce3-d669-4636-bff6-edfd1dd7726b None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.237091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88ce3-d669-4636-bff6-edfd1dd7726b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.237258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88ce3-d669-4636-bff6-edfd1dd7726b None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.239074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 449/891] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:23.247049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79202-35d6-4853-a7c4-9353efdf6fb7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.247705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79202-35d6-4853-a7c4-9353efdf6fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.248182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79202-35d6-4853-a7c4-9353efdf6fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.248748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8018820-b1f6-4703-91ef-0bfb2d0619be None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:23.269288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c8f79202-35d6-4853-a7c4-9353efdf6fb7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:23.271129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c8f79202-35d6-4853-a7c4-9353efdf6fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:23.284186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:23.315648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:23.316701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.317251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.317713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.318903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:23.319432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:23.322146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:23.329789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 443/892] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:23.336763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:23.387971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 450/893] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:23.503930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846dc44-23e5-430b-b4ab-23984b89e248 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.504133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846dc44-23e5-430b-b4ab-23984b89e248 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.504393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846dc44-23e5-430b-b4ab-23984b89e248 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.505796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 451/894] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:23.506676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846dc44-23e5-430b-b4ab-23984b89e248 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:23.514298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f395d-7a47-4b65-a2c6-7a6d1ec6e6b2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:23.555363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:23.566299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecdd1f-5ee3-4cc6-b98a-d792bcb40b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:23.566997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecdd1f-5ee3-4cc6-b98a-d792bcb40b72 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.567273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecdd1f-5ee3-4cc6-b98a-d792bcb40b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.567568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecdd1f-5ee3-4cc6-b98a-d792bcb40b72 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.568275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecdd1f-5ee3-4cc6-b98a-d792bcb40b72 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:23.568579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecdd1f-5ee3-4cc6-b98a-d792bcb40b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:23.570106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecdd1f-5ee3-4cc6-b98a-d792bcb40b72 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:23.577553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 444/895] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Aug 30 14:31:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:23.578757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781338-cb49-40b5-933f-e6d652919f81 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.579032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781338-cb49-40b5-933f-e6d652919f81 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.579298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781338-cb49-40b5-933f-e6d652919f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.605519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-36781338-cb49-40b5-933f-e6d652919f81 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:23.606947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-36781338-cb49-40b5-933f-e6d652919f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:23.704039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 445/896] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:23.704892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781338-cb49-40b5-933f-e6d652919f81 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:23.816678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846dc44-23e5-430b-b4ab-23984b89e248 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:23.840690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781338-cb49-40b5-933f-e6d652919f81 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:23.876477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231e95-a4fd-41c0-acb9-cc7a0cb597f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:23.877035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:23.878218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231e95-a4fd-41c0-acb9-cc7a0cb597f7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.878602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231e95-a4fd-41c0-acb9-cc7a0cb597f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.879374 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231e95-a4fd-41c0-acb9-cc7a0cb597f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.893948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9877c-677f-4f12-aa6e-b2b14cd3a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:23.894789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9877c-677f-4f12-aa6e-b2b14cd3a63e None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:23.895100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9877c-677f-4f12-aa6e-b2b14cd3a63e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:23.895391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9877c-677f-4f12-aa6e-b2b14cd3a63e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:23.896147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9877c-677f-4f12-aa6e-b2b14cd3a63e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:23.897632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9877c-677f-4f12-aa6e-b2b14cd3a63e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:23.900880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e231e95-a4fd-41c0-acb9-cc7a0cb597f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-6e231e95-a4fd-41c0-acb9-cc7a0cb597f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:23.911066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:23.913086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:23.914916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:23.918453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 452/897] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Aug 30 14:31:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:23.920878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231e95-a4fd-41c0-acb9-cc7a0cb597f7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:23.929008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 446/898] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:31:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:23.930274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9877c-677f-4f12-aa6e-b2b14cd3a63e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:23.947135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:24.074328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231e95-a4fd-41c0-acb9-cc7a0cb597f7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:24.128353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dc3be-8964-4c2f-b8d3-62f9c95af03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:24.129431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc3be-8964-4c2f-b8d3-62f9c95af03d None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:24.129848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc3be-8964-4c2f-b8d3-62f9c95af03d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:24.130422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dc3be-8964-4c2f-b8d3-62f9c95af03d None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:24.131520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dc3be-8964-4c2f-b8d3-62f9c95af03d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:24.133910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dc3be-8964-4c2f-b8d3-62f9c95af03d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:24.141043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9877c-677f-4f12-aa6e-b2b14cd3a63e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:24.152457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 453/899] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:31:23 2022] POST /identity/v3/services => generated 241 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:24.153212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dc3be-8964-4c2f-b8d3-62f9c95af03d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:24.237636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:24.239317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:24.240149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:24.240930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:24.243730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:24.244449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:24.247168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:24.255791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:24.263269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 447/900] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Aug 30 14:31:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:24.272063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:24.331911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:24.363540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dc3be-8964-4c2f-b8d3-62f9c95af03d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:24.416423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41319-c1f7-4ffd-a9e4-8e247fb45219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:24.417060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41319-c1f7-4ffd-a9e4-8e247fb45219 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:24.417330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41319-c1f7-4ffd-a9e4-8e247fb45219 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:24.417596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e41319-c1f7-4ffd-a9e4-8e247fb45219 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:24.418272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e41319-c1f7-4ffd-a9e4-8e247fb45219 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:24.419828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e41319-c1f7-4ffd-a9e4-8e247fb45219 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:24.442139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 454/901] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:31:24 2022] POST /identity/v3/services => generated 269 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:24.484376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62452ee3-9f4f-4ae4-8593-6efd3d0e282e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:24.580759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:24.582036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:24.582473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:24.582933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:24.606272 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:24.609339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:24.639900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:24.640970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:24.641873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:24.641873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:24.641873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:24.643505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 448/902] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:24.652464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41319-c1f7-4ffd-a9e4-8e247fb45219 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:24.782233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e41319-c1f7-4ffd-a9e4-8e247fb45219 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:24.810950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:24.832288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:24.833252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:24.833733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:24.834192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:24.835424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:24.835994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:24.838900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:24.863188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 455/903] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:24.872911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:25.043745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:25.072751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7178b-4a8d-4353-964a-5d0dd69c2449 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:25.135509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:25.136457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:25.136938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:25.137404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:25.153079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:25.155865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:25.178808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:25.180746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:25.182634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 449/904] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:31:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:25.194687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:25.356485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9084f-8776-4001-9729-4954bf0d6ef9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:25.420878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:25.421511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:25.421779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:25.422048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:25.430444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:25.430444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:25.430444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:25.450955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 456/905] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Aug 30 14:31:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:25.460315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:25.677420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528eda-3f19-4925-86be-6d2d82ebcab0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:25.756167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36857aa5-73f2-4696-964a-20f5d13f6283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:25.757220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857aa5-73f2-4696-964a-20f5d13f6283 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:25.757718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857aa5-73f2-4696-964a-20f5d13f6283 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:25.758263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857aa5-73f2-4696-964a-20f5d13f6283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:25.826940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:25.930502 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36857aa5-73f2-4696-964a-20f5d13f6283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:25.933390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36857aa5-73f2-4696-964a-20f5d13f6283 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:26.140878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 450/906] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:31:26.149884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:26.233984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:26.311673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1e76e-af9c-4ab7-8d74-33fc5fcab217 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:26.363014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:26.364301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:26.364825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:26.365321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:26.391671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:26.394424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:26.430421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:26.431439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:26.432387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:26.432387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:26.432387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:26.432387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 457/907] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:26.434536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefedd2-1e5f-46c8-8891-1065b3e803a5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:26.435030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefedd2-1e5f-46c8-8891-1065b3e803a5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:26.435474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefedd2-1e5f-46c8-8891-1065b3e803a5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:26.437255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:26.437998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 451/908] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:26.448869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e265-68df-4553-a30b-ed2d3acb9afe None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:26.458741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e265-68df-4553-a30b-ed2d3acb9afe None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:26.458741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54e265-68df-4553-a30b-ed2d3acb9afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:26.497409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5f54e265-68df-4553-a30b-ed2d3acb9afe None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:26.504573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5f54e265-68df-4553-a30b-ed2d3acb9afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:26.597710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:26.601391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:26.626531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763048b-ae2c-434f-b3d9-78319321547d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:26.638773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 452/909] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:26.697138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371349ca-f0d9-468e-9c48-be4a27410a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:26.698263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371349ca-f0d9-468e-9c48-be4a27410a5e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:26.698790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371349ca-f0d9-468e-9c48-be4a27410a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:26.699260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371349ca-f0d9-468e-9c48-be4a27410a5e None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:26.700396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371349ca-f0d9-468e-9c48-be4a27410a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:26.701293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371349ca-f0d9-468e-9c48-be4a27410a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:26.703912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371349ca-f0d9-468e-9c48-be4a27410a5e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:26.729257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 458/910] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:26.738564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54e265-68df-4553-a30b-ed2d3acb9afe None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:26.747200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087f60-9c5e-48b9-8897-ee73b3f0afb3 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:26.747735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087f60-9c5e-48b9-8897-ee73b3f0afb3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:26.748136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087f60-9c5e-48b9-8897-ee73b3f0afb3 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:26.751071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 459/911] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:26.758815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3b26-23c2-43d9-9bf9-5371ac472b44 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:26.759232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3b26-23c2-43d9-9bf9-5371ac472b44 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:26.759641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3b26-23c2-43d9-9bf9-5371ac472b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:26.785769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e70f3b26-23c2-43d9-9bf9-5371ac472b44 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:26.787077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e70f3b26-23c2-43d9-9bf9-5371ac472b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:26.907352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54e265-68df-4553-a30b-ed2d3acb9afe None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:26.931717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 460/912] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:26.952252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3b26-23c2-43d9-9bf9-5371ac472b44 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:26.980100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:26.981308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:26.982169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:26.982700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:27.001732 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:27.005895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:27.039389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:27.040430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:27.041315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:27.041315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:27.041315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:27.041315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:27.041315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:27.041315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:27.041315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:27.041315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:27.042336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 453/913] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:27.051407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:27.064079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:27.102677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3b26-23c2-43d9-9bf9-5371ac472b44 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:27.129572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:27.163638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:27.164566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:27.164907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:27.166698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:27.166698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:27.167524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:27.170617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING keystone.server.flask.common [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 14:31:27.195092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.sql.core [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:31:27.195092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 14:31:27.195092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [parameters: {'id': 'eb980fb6e75f47a9a4254b3ef233fe4d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 14:31:27.195092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81723) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb980fb6e75f47a9a4254b3ef233fe4d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb980fb6e75f47a9a4254b3ef233fe4d. Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:31:27.204372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 14:31:27.205960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application yield resource Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise self.value Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application session.commit() Aug 30 14:31:27.208664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:31:27.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:31:27.214206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application result.read() Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:31:27.215999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [parameters: {'id': 'eb980fb6e75f47a9a4254b3ef233fe4d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:27.217902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:27.219608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb980fb6e75f47a9a4254b3ef233fe4d. Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 461/914] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Aug 30 14:31:26 2022] POST /identity/v3/projects => generated 262 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:27.222253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:27.263236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00a862-e82b-4f69-8190-931e45a1e25d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:27.310306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:27.311554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:27.312124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:27.312730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:27.314175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:27.314799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:27.317759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:27.344423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 454/915] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:27.344423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:27.362118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ed80b-5b68-472b-b4c0-d21aa3f27324 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:27.404029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:27.404679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:27.404955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:27.405224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:27.405821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:27.407472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:27.421167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:27.423039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:27.424581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 462/916] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:27.426140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:27.430960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:27.492594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:27.508719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab438-6a9a-4c9f-aa10-7214f4ad429e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:27.552971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:27.553616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:27.553898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:27.554159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:27.561579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:27.563074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:27.574927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:27.576980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 455/917] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:27.578755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:27.598455 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5afab1-a538-4ab0-92ba-15a581303c04 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:27.660898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:27.662264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:27.662799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:27.663671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:27.666063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] RBAC: Adding query filter params (role.id=479ed6989eb3488f891ace3940e62ad2, scope.project.id=fabb84470909411f80adffac902dea45, user.id=a73f6352d0b04774bdf1ce68388cc940) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:27.666639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:27.669548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:27.694436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 463/918] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:27 2022] GET /identity/v3/role_assignments?user.id=a73f6352d0b04774bdf1ce68388cc940&scope.project.id=fabb84470909411f80adffac902dea45&role.id=479ed6989eb3488f891ace3940e62ad2 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:27.694436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:27.706058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7532-1ca1-454a-837e-03eb86051715 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:27.749233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:27.749970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:27.750317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:27.750724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:27.751417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:27.751794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:27.753496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:27.768223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 456/919] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:27.777357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:27.809069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:27.843918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:27.897388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9c32c-a126-464d-ba4e-caabffd21e0a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:27.953091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9e02-4a19-4b51-8db3-20d78152c487 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:27.956721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461f937-d76c-4161-aeac-c3e0c6afffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:27.957844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461f937-d76c-4161-aeac-c3e0c6afffbd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:27.958312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461f937-d76c-4161-aeac-c3e0c6afffbd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:27.958816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461f937-d76c-4161-aeac-c3e0c6afffbd None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:27.959999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461f937-d76c-4161-aeac-c3e0c6afffbd None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:27.960524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461f937-d76c-4161-aeac-c3e0c6afffbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:27.963275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461f937-d76c-4161-aeac-c3e0c6afffbd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:27.995415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 464/920] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:27.997948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27735-2f66-44b0-917d-fc070514d6a4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:27.998486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27735-2f66-44b0-917d-fc070514d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:27.998991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f27735-2f66-44b0-917d-fc070514d6a4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:28.001454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 465/921] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:28.008966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:28.010291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:28.010676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7b983-670b-4fa8-8b88-d15fd6a7a8ad None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:28.011150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7b983-670b-4fa8-8b88-d15fd6a7a8ad None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:28.011399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:28.011596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7b983-670b-4fa8-8b88-d15fd6a7a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:28.012252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:28.013474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:28.014139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:28.017014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:28.035019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 457/922] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:28.040286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:28.046687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a8d7b983-670b-4fa8-8b88-d15fd6a7a8ad None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:28.049724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a8d7b983-670b-4fa8-8b88-d15fd6a7a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:28.199073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 466/923] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:28.213176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:28.238635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a164f25-a4cf-4d48-8bf2-05eedd134863 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:28.282750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:28.283388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:28.283667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:28.283937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:28.284657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] RBAC: Adding query filter params (interface=public, service_id=1e36bb190d0a4629ac470a6c48a76f25, region_id=RegionOne) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:28.284964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:28.286395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:28.296272 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 458/924] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Aug 30 14:31:28 2022] GET /identity/v3/endpoints?service_id=1e36bb190d0a4629ac470a6c48a76f25&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:28.304334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7b983-670b-4fa8-8b88-d15fd6a7a8ad None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:28.398470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:28.459745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7b983-670b-4fa8-8b88-d15fd6a7a8ad None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:28.502877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff5acd-6820-4e6d-ba60-6adf0de3aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:28.502877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff5acd-6820-4e6d-ba60-6adf0de3aea8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:28.502877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff5acd-6820-4e6d-ba60-6adf0de3aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:28.503428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff5acd-6820-4e6d-ba60-6adf0de3aea8 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:28.503800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff5acd-6820-4e6d-ba60-6adf0de3aea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:28.505060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff5acd-6820-4e6d-ba60-6adf0de3aea8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:28.513734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 467/925] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:31:28 2022] GET /identity/v3/services => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:31:28.712926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:28.913788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513e698-9a89-46bc-a18d-ed9baa6caf14 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:28.989913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:28.991005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:28.991482 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:28.991961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:28.993496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:28.995919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:29.013015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:29.014022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:29.014922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:29.016401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 459/926] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Aug 30 14:31:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:29.025615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff5acd-6820-4e6d-ba60-6adf0de3aea8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:29.217853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff5acd-6820-4e6d-ba60-6adf0de3aea8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:29.241245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:29.259628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:29.260270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:29.260549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:29.260819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:29.261467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:29.261774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:29.263367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:29.269415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 468/927] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:29.278726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:29.303330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:29.473206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90018e73-1ebd-4d53-96f9-55abffee6c23 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:29.538544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:29.539717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:29.540206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:29.540682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:29.541847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:29.542370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:29.544906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:29.555352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 460/928] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:29.564690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:29.739395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dbd22-c0fb-4f17-8f5c-ee66b50c9c7a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:29.780199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b478c0-5a60-4ec5-8ac9-536adb1a2a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:29.780827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b478c0-5a60-4ec5-8ac9-536adb1a2a27 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:29.781124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b478c0-5a60-4ec5-8ac9-536adb1a2a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:29.781368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b478c0-5a60-4ec5-8ac9-536adb1a2a27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:29.782086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b478c0-5a60-4ec5-8ac9-536adb1a2a27 None admin] RBAC: Adding query filter params (interface=public, service_id=764c4afb5f7c45b3ae521640121d95e5, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:29.782408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b478c0-5a60-4ec5-8ac9-536adb1a2a27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:29.783851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b478c0-5a60-4ec5-8ac9-536adb1a2a27 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:29.791109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 469/929] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Aug 30 14:31:29 2022] GET /identity/v3/endpoints?service_id=764c4afb5f7c45b3ae521640121d95e5&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:29.798498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:29.909529 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:29.938817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662cd17-9089-4515-974e-2d671e0f5b68 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:29.976911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65332bbb-0887-4fc5-8fea-8a61c48708c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:29.977544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332bbb-0887-4fc5-8fea-8a61c48708c2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:29.977822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332bbb-0887-4fc5-8fea-8a61c48708c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:29.978095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332bbb-0887-4fc5-8fea-8a61c48708c2 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:29.978743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65332bbb-0887-4fc5-8fea-8a61c48708c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:29.980134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65332bbb-0887-4fc5-8fea-8a61c48708c2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:29.987278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 461/930] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:31:29 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:31:30.000962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279d3bf-01ab-4692-96e0-0d9028951fcc None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.001572 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279d3bf-01ab-4692-96e0-0d9028951fcc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.002047 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279d3bf-01ab-4692-96e0-0d9028951fcc None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.004098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 470/931] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:30.010845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85bbe-d85c-4042-8d2f-b7653ae6261b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.011463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85bbe-d85c-4042-8d2f-b7653ae6261b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.011866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85bbe-d85c-4042-8d2f-b7653ae6261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.033484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d8d85bbe-d85c-4042-8d2f-b7653ae6261b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:30.035341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d8d85bbe-d85c-4042-8d2f-b7653ae6261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:30.118177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 462/932] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:30.386884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279d3bf-01ab-4692-96e0-0d9028951fcc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:30.458791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:30.518411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279d3bf-01ab-4692-96e0-0d9028951fcc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:30.556849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d06dc-c7ad-46e1-aad9-75c82a008576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:30.557507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d06dc-c7ad-46e1-aad9-75c82a008576 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.557781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d06dc-c7ad-46e1-aad9-75c82a008576 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.558045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d06dc-c7ad-46e1-aad9-75c82a008576 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.570022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d06dc-c7ad-46e1-aad9-75c82a008576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d35d06dc-c7ad-46e1-aad9-75c82a008576 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:30.575042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:30.576406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:30.577226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 471/933] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Aug 30 14:31:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:30.584586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d85bbe-d85c-4042-8d2f-b7653ae6261b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:30.659285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:30.697804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d85bbe-d85c-4042-8d2f-b7653ae6261b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:30.735698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba066fe7-67a9-4ed3-835b-093e9aaf8182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:30.736741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066fe7-67a9-4ed3-835b-093e9aaf8182 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.737231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066fe7-67a9-4ed3-835b-093e9aaf8182 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.737694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba066fe7-67a9-4ed3-835b-093e9aaf8182 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.738596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba066fe7-67a9-4ed3-835b-093e9aaf8182 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:30.739097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba066fe7-67a9-4ed3-835b-093e9aaf8182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:30.740690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba066fe7-67a9-4ed3-835b-093e9aaf8182 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:30.750895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 463/934] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Aug 30 14:31:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:30.757441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d06dc-c7ad-46e1-aad9-75c82a008576 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:30.832959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160328ab-3943-4117-85db-448c7f642e38 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.833262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160328ab-3943-4117-85db-448c7f642e38 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.833600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160328ab-3943-4117-85db-448c7f642e38 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.835958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 464/935] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:30.841518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43ca9-56bb-4413-8ebe-af5f4f4f7e6b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.841907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43ca9-56bb-4413-8ebe-af5f4f4f7e6b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.842084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43ca9-56bb-4413-8ebe-af5f4f4f7e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.862223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-94b43ca9-56bb-4413-8ebe-af5f4f4f7e6b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:30.863460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-94b43ca9-56bb-4413-8ebe-af5f4f4f7e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:30.913309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d06dc-c7ad-46e1-aad9-75c82a008576 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:30.924259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:30.951971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 465/936] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:30.953271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb28c8-ffb2-4ef5-a76e-9c7a0ab72993 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.953554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb28c8-ffb2-4ef5-a76e-9c7a0ab72993 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.953817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb28c8-ffb2-4ef5-a76e-9c7a0ab72993 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.958543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 466/937] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:30.962226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4050b-8067-499a-96d3-3aa2f5146e61 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.962617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4050b-8067-499a-96d3-3aa2f5146e61 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.963593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4050b-8067-499a-96d3-3aa2f5146e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.968231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:30.969609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:30.970104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:30.970981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:30.983720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f8f4050b-8067-499a-96d3-3aa2f5146e61 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:30.984980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f8f4050b-8067-499a-96d3-3aa2f5146e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:30.987537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:30.989498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:31.011824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:31.013252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:31.014534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:31.014534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:31.014534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:31.017530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 472/938] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:31.023116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:31.052832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:31.066831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 467/939] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:31.167897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31209339-7245-418e-ad8d-74c68ac20f0d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:31.225345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:31.226599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:31.227100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:31.227584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:31.228872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:31.229384 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:31.231783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:31.255612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 473/940] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:31.261952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4050b-8067-499a-96d3-3aa2f5146e61 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:31.391170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4050b-8067-499a-96d3-3aa2f5146e61 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:31.403591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:31.439640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:31.447944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:31.448596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:31.448881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:31.449155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:31.460570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:31.463247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:31.486617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:31.488064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:31.489506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 468/941] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:31:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:31.491643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:31.547279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299da3-7e92-420a-ac75-72f7c205eb5e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:31.579879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:31.593908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:31.595015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:31.595452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:31.595922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:31.596532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:31.597927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:31.608647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:31.610972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:31.612620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 474/942] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:31.613674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:31.672373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533dfd8-b28a-4337-a558-b0c960e8d510 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:31.718410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:31.729131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:31.730075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:31.730561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:31.731001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:31.731846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:31.733632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:31.736253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING keystone.server.flask.common [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 14:31:31.745888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba72e31-5df3-452c-b959-834d2625e189 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:31.751057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.sql.core [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:31:31.751057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 14:31:31.751057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [parameters: {'user_id': '43ef8a4daf2c47b18f51c4b0557b66be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 14:31:31.751057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81722) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result.read() Aug 30 14:31:31.768791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:31:31.770978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application yield resource Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application next(self.gen) Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise self.value Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application session.commit() Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 14:31:31.772861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.session.flush() Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application compat.raise_( Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 14:31:31.775753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 14:31:31.779868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application conn.query(q) Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application result.read() Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 14:31:31.783203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [parameters: {'user_id': '43ef8a4daf2c47b18f51c4b0557b66be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:31.786622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 14:31:31.789861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 14:31:31.793621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 14:31:31.793621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 14:31:31.793621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 14:31:31.793621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 14:31:31.793621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 14:31:31.793621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:31.793621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 469/943] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Aug 30 14:31:31 2022] POST /identity/v3/users => generated 160 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:31.793621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:31.807054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:31.808157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:31.808457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:31.808956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:31.809346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:31.809673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:31.811530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:31.835193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 475/944] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Aug 30 14:31:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:31.836398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:31.921064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d3a6b-1b85-4510-a09c-1161f564b8cc None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:31.945744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:31.981438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb5a77-330d-4c39-b659-bac1e43bbc69 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:31.988123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:31.989095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:31.989504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:31.989913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:31.990941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:31.991458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:31.994192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:32.010429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 470/945] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:32.010429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:32.036484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:32.037469 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.037838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.038301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.049280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:32.052704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:32.067634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:32.068650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 476/946] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:31:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:32.075094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:32.153479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90efcac-b74a-4082-a040-76264bd927f9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:32.188571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3389e7-9324-47e0-9d6b-acbce2e22768 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:32.190603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2210566-8eec-4f84-b178-7c18c3b0ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:32.191270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2210566-8eec-4f84-b178-7c18c3b0ef89 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.191562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2210566-8eec-4f84-b178-7c18c3b0ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.191829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2210566-8eec-4f84-b178-7c18c3b0ef89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.204973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2210566-8eec-4f84-b178-7c18c3b0ef89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:32.206403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2210566-8eec-4f84-b178-7c18c3b0ef89 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c2210566-8eec-4f84-b178-7c18c3b0ef89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:32.223003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:32.224334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:32.225611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:32.225611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:32.225611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:32.225611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 471/947] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:32.227905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce30c-3f40-4ed7-9e4e-0c6540714b5b None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.228385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce30c-3f40-4ed7-9e4e-0c6540714b5b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.228840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce30c-3f40-4ed7-9e4e-0c6540714b5b None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.234409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 472/948] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:32.234409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ce30c-3f40-4ed7-9e4e-0c6540714b5b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:32.241769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:32.242441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.242720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.242979 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.244226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:32.244526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:32.245951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:32.252036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 477/949] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:32.252931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:32.269974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:32.328447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:32.362305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ce30c-3f40-4ed7-9e4e-0c6540714b5b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:32.369552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d993745-4dc9-45d6-ac3e-f81526dac251 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:32.407553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:32.408394 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.408754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.409147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.410300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:32.410755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:32.412396 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:32.418661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e0d1f-0f7e-4ed9-9631-30919fc71117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:32.419614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0d1f-0f7e-4ed9-9631-30919fc71117 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.420054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0d1f-0f7e-4ed9-9631-30919fc71117 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.420482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e0d1f-0f7e-4ed9-9631-30919fc71117 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.421555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e0d1f-0f7e-4ed9-9631-30919fc71117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:32.422038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e0d1f-0f7e-4ed9-9631-30919fc71117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:32.424435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e0d1f-0f7e-4ed9-9631-30919fc71117 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:32.445703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 478/950] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:32.447955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2303c-b4e9-4547-93d3-70a1ff7a4adb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.448406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2303c-b4e9-4547-93d3-70a1ff7a4adb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.448836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2303c-b4e9-4547-93d3-70a1ff7a4adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.475129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 473/951] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Aug 30 14:31:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:32.475487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-01e2303c-b4e9-4547-93d3-70a1ff7a4adb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:32.475943 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:32.477516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-01e2303c-b4e9-4547-93d3-70a1ff7a4adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:32.578538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 479/952] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:32.579912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2303c-b4e9-4547-93d3-70a1ff7a4adb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:32.617082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:32.653839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01916ef4-100b-47c5-a627-628beacce080 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:32.690916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:32.721848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97213036-bd17-4315-964a-41ba028569b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:32.722830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97213036-bd17-4315-964a-41ba028569b8 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.723265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97213036-bd17-4315-964a-41ba028569b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.723709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97213036-bd17-4315-964a-41ba028569b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.724821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97213036-bd17-4315-964a-41ba028569b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:32.727494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97213036-bd17-4315-964a-41ba028569b8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:32.760758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 474/953] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:31:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:32.778661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2303c-b4e9-4547-93d3-70a1ff7a4adb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:32.859219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:32.861213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97213036-bd17-4315-964a-41ba028569b8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:32.862123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:32.862625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:32.863194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:32.876642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:32.879275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:32.895130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:32.897269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:32.900108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 480/954] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:32.905452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:33.042456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97213036-bd17-4315-964a-41ba028569b8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:33.064254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39fba2-c359-4ee6-aa0f-278a4ff0c707 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:33.082812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:33.107776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:33.109195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:33.109669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:33.110138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:33.111197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:33.113744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:33.119388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:33.120682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:33.121351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:33.122011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:33.123475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:33.124208 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:33.127204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:33.130282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:33.132387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:33.134411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 475/955] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Aug 30 14:31:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:33.139403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:33.156724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:33.157533 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 481/956] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:33.168060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:33.320254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d82b33-0f4f-4910-808a-856e7297128a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:33.344511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9796c-e977-4cb8-861e-89c76f81ca22 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:33.385106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:33.385743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:33.386020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:33.386289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:33.386971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:33.387269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:33.388719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:33.394443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 476/957] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:33.399518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88820e6-9c81-4768-b4c0-883b40efcfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:33.400736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88820e6-9c81-4768-b4c0-883b40efcfd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:33.400918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:33.401244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88820e6-9c81-4768-b4c0-883b40efcfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:33.401717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88820e6-9c81-4768-b4c0-883b40efcfd3 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/a73f6352d0b04774bdf1ce68388cc940/roles/479ed6989eb3488f891ace3940e62ad2` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:33.407566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88820e6-9c81-4768-b4c0-883b40efcfd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=a73f6352d0b04774bdf1ce68388cc940, role_id=479ed6989eb3488f891ace3940e62ad2)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:33.413189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88820e6-9c81-4768-b4c0-883b40efcfd3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:33.440605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 482/958] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:31:33 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/a73f6352d0b04774bdf1ce68388cc940/roles/479ed6989eb3488f891ace3940e62ad2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:31:33.551917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:33.621713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24764a-4da6-4dc6-9d7c-f8529e8c1420 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:33.679799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65236ab4-f1ca-4e3f-bc58-e1d8cf143279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:33.680995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236ab4-f1ca-4e3f-bc58-e1d8cf143279 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:33.681567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236ab4-f1ca-4e3f-bc58-e1d8cf143279 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:33.682121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236ab4-f1ca-4e3f-bc58-e1d8cf143279 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:33.683417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65236ab4-f1ca-4e3f-bc58-e1d8cf143279 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:33.684031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65236ab4-f1ca-4e3f-bc58-e1d8cf143279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:33.686729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65236ab4-f1ca-4e3f-bc58-e1d8cf143279 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:33.696597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 477/959] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:33.705901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88820e6-9c81-4768-b4c0-883b40efcfd3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:33.764305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:33.906069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88820e6-9c81-4768-b4c0-883b40efcfd3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:33.969603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f91c4-d603-4d2c-a5e9-60c7f540e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:33.970710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f91c4-d603-4d2c-a5e9-60c7f540e8df None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:33.971184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f91c4-d603-4d2c-a5e9-60c7f540e8df None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:33.971650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f91c4-d603-4d2c-a5e9-60c7f540e8df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:33.972865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f91c4-d603-4d2c-a5e9-60c7f540e8df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:33.975536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f91c4-d603-4d2c-a5e9-60c7f540e8df None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:34.022418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 483/960] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:31:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:34.913376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debe8e-b872-4f97-ad6e-80401db5ff70 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:34.914106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debe8e-b872-4f97-ad6e-80401db5ff70 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:34.914106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debe8e-b872-4f97-ad6e-80401db5ff70 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:34.915919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 478/961] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:34.922219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148036a9-02b5-469c-89b1-9df4bd5f3a56 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:34.922823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148036a9-02b5-469c-89b1-9df4bd5f3a56 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:34.923157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148036a9-02b5-469c-89b1-9df4bd5f3a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:34.952700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-148036a9-02b5-469c-89b1-9df4bd5f3a56 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:34.954752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-148036a9-02b5-469c-89b1-9df4bd5f3a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:35.094314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 484/962] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:35.558601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01189d03-4ca8-4cf8-9bcb-c71766fb1563 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:35.559079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01189d03-4ca8-4cf8-9bcb-c71766fb1563 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:35.559518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01189d03-4ca8-4cf8-9bcb-c71766fb1563 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:35.561982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 479/963] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:35.567969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bce89-4a97-45bb-8655-41f031ee4ccd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:35.568429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bce89-4a97-45bb-8655-41f031ee4ccd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:35.568586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bce89-4a97-45bb-8655-41f031ee4ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:35.589862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-042bce89-4a97-45bb-8655-41f031ee4ccd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:35.591129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-042bce89-4a97-45bb-8655-41f031ee4ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:35.598817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01189d03-4ca8-4cf8-9bcb-c71766fb1563 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:35.603296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:35.721392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 485/964] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:35.769478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01189d03-4ca8-4cf8-9bcb-c71766fb1563 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:35.835695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:35.836828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:35.837459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:35.837915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:35.839008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:35.841635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:35.845040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:35.861959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:35.864168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:35.865815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:35.870812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 480/965] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:35.873813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bce89-4a97-45bb-8655-41f031ee4ccd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:36.063346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bce89-4a97-45bb-8655-41f031ee4ccd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:36.109631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:36.128463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:36.129502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.129976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.130443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.131573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:36.132078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:36.134702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:36.144756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 486/966] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:36.154885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:36.175367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:36.267202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd47652-2efc-47b6-ab92-a7376f3e7cf4 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:36.328800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594e353-04ce-45bd-ae99-01da2be4f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:36.329640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594e353-04ce-45bd-ae99-01da2be4f814 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.329912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594e353-04ce-45bd-ae99-01da2be4f814 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.330192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594e353-04ce-45bd-ae99-01da2be4f814 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.343576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594e353-04ce-45bd-ae99-01da2be4f814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-2594e353-04ce-45bd-ae99-01da2be4f814 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:36.349091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:36.351010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:36.353788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:36.358510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2174345-2cbe-4e5d-8c7e-9de43420421e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:36.358773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 481/967] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Aug 30 14:31:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:36.358773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594e353-04ce-45bd-ae99-01da2be4f814 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:36.426594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:36.427642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.428128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.428608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.430860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:36.431444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:36.434054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:36.440679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:36.445406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 487/968] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:36.455571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:36.502766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594e353-04ce-45bd-ae99-01da2be4f814 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:36.540628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7e66b-3149-4d22-b441-b7ae2a6be6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:36.541255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e66b-3149-4d22-b441-b7ae2a6be6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.541532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e66b-3149-4d22-b441-b7ae2a6be6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.541803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7e66b-3149-4d22-b441-b7ae2a6be6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.542502 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e66b-3149-4d22-b441-b7ae2a6be6b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:36.542806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e66b-3149-4d22-b441-b7ae2a6be6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:36.544196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7e66b-3149-4d22-b441-b7ae2a6be6b4 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:36.553442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 482/969] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Aug 30 14:31:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:36.554829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21256-b2c9-404a-82d3-4d2c7a55be44 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.555105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21256-b2c9-404a-82d3-4d2c7a55be44 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.555401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21256-b2c9-404a-82d3-4d2c7a55be44 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.556928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 483/970] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:36.562336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148687d-11fb-409c-8255-27d5f3a486cb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.562638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148687d-11fb-409c-8255-27d5f3a486cb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.562917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148687d-11fb-409c-8255-27d5f3a486cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.569741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:36.590481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4148687d-11fb-409c-8255-27d5f3a486cb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:36.592722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4148687d-11fb-409c-8255-27d5f3a486cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:36.614519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa9909-457d-4c58-9aff-ba3daed637b9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:36.653274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:36.653912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.654193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.654504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.655217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] RBAC: Adding query filter params (interface=admin, service_id=1e36bb190d0a4629ac470a6c48a76f25, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:36.655525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:36.656947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:36.662791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 488/971] 10.222.0.49 () {56 vars in 1249 bytes} [Tue Aug 30 14:31:36 2022] GET /identity/v3/endpoints?service_id=1e36bb190d0a4629ac470a6c48a76f25&interface=admin®ion_id=RegionOne => generated 193 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:36.664126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:36.685325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 484/972] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:36.686646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148687d-11fb-409c-8255-27d5f3a486cb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:36.785695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:36.791413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d24b0-292a-4485-b1bb-c4eacbc694ce None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:36.839680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:36.840327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.840678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.840973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.844849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:36.859935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:36.861971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:36.880978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148687d-11fb-409c-8255-27d5f3a486cb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:36.882138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:36.884214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:36.886203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:36.886203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:36.886203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:36.890701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 489/973] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:36.891888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:36.940039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee12f9-1f85-496b-b12b-8ae10c589df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:36.941004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee12f9-1f85-496b-b12b-8ae10c589df2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:36.941460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee12f9-1f85-496b-b12b-8ae10c589df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:36.941888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee12f9-1f85-496b-b12b-8ae10c589df2 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:36.943176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee12f9-1f85-496b-b12b-8ae10c589df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:36.945007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee12f9-1f85-496b-b12b-8ae10c589df2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:36.955521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 485/974] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:31:36 2022] GET /identity/v3/services => generated 1497 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:31:36.961195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee12f9-1f85-496b-b12b-8ae10c589df2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:37.051224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238cc10-509f-4212-9dab-657b04d2d243 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:37.100858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:37.102132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:37.102306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:37.102593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:37.103551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:37.103922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:37.106029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:37.116389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee12f9-1f85-496b-b12b-8ae10c589df2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:37.122870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 490/975] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:37.128886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:37.136824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:37.163809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:37.164511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:37.164784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:37.165141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:37.165739 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:37.167179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:37.176831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:37.177916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:37.179309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 486/976] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:37.184662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:37.195477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:37.258302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b24dc4-35e7-4522-86b3-6ab9a2b6db30 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:37.318585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0603bf0-3c22-4822-87d4-b33af68ce449 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:37.321604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:37.322864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:37.323416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:37.323981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:37.338126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:37.340726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:37.359490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:37.360124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:37.360464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:37.360577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:37.361683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 14:31:37.362910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:37.363608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:37.363608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:37.363897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:37.365402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 491/977] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:31:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:37.365544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:37.376169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 487/978] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:37.377184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:37.377359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:37.445964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:37.521419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f903-50d6-4c41-8089-da027fe2ff81 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:37.540479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:37.552459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36ae54-07e3-4606-b825-cf55ab42c089 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:37.589817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:37.590968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:37.591551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:37.592092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:37.593336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:37.593951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:37.596281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:37.613038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:37.613678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:37.614084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:37.614574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:37.615721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:37.616285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:37.619032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:37.635957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 488/979] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:37.636168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 492/980] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Aug 30 14:31:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:37.636263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:37.762650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd13cc-d5ce-4784-8316-d925a82c7868 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:37.771368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:37.805880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225ca30-3789-421b-ae8d-25e17a393ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:37.806686 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ca30-3789-421b-ae8d-25e17a393ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:37.807029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ca30-3789-421b-ae8d-25e17a393ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:37.807363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ca30-3789-421b-ae8d-25e17a393ea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:37.903685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225ca30-3789-421b-ae8d-25e17a393ea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:37.906235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225ca30-3789-421b-ae8d-25e17a393ea3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:38.051905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 489/981] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:31:38.057842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:38.197095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930952bb-f5a1-43bc-bc27-b6652e313f99 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:38.253138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:38.254228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:38.254763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:38.255241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:38.273670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:38.276372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:38.304567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:38.305924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:38.306864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:38.306864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:38.306864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:38.307438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 493/982] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:38.313067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225ca30-3789-421b-ae8d-25e17a393ea3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:38.322593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:38.441043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225ca30-3789-421b-ae8d-25e17a393ea3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:38.486009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:38.486741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:38.487110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:38.487469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:38.488231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:38.488621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:38.490177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:38.505472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 490/983] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:38.511411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:38.547961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:38.686195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359b117-5b97-4ac4-9e7f-a25ef320652c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:38.735224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:38.735884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:38.736217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:38.736434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:38.744459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:38.745975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:38.758709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:38.759674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:38.765446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 494/984] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:38.766788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:38.844827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:38.914143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1a74c-b78d-4890-a52a-d08569f0e725 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:38.972913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04257e-aafd-4f3c-a2ab-ec40d626548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:38.973716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04257e-aafd-4f3c-a2ab-ec40d626548e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:38.974162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04257e-aafd-4f3c-a2ab-ec40d626548e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:38.974597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04257e-aafd-4f3c-a2ab-ec40d626548e None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:38.975654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04257e-aafd-4f3c-a2ab-ec40d626548e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:38.976264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04257e-aafd-4f3c-a2ab-ec40d626548e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:38.978669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04257e-aafd-4f3c-a2ab-ec40d626548e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:38.994470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 491/985] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:39.000387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:39.042648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81172-e040-4b4a-8c7d-02755400bbaf None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:39.042938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81172-e040-4b4a-8c7d-02755400bbaf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:39.043196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d81172-e040-4b4a-8c7d-02755400bbaf None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:39.044913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 492/986] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:39.051366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af133-0a45-4b39-8621-0c32dcec6be1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:39.052045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af133-0a45-4b39-8621-0c32dcec6be1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:39.052325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af133-0a45-4b39-8621-0c32dcec6be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:39.073289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a60af133-0a45-4b39-8621-0c32dcec6be1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:39.075606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a60af133-0a45-4b39-8621-0c32dcec6be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:39.144829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:39.181213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 493/987] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:39.187269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4018-53aa-42a7-9dfc-98c8068b0043 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:39.251139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:39.252099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:39.252444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:39.252793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:39.254052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] RBAC: Adding query filter params (role.id=479ed6989eb3488f891ace3940e62ad2, scope.project.id=fabb84470909411f80adffac902dea45, user.id=a73f6352d0b04774bdf1ce68388cc940) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:39.254363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:39.256738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:39.267858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 495/988] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:38 2022] GET /identity/v3/role_assignments?user.id=a73f6352d0b04774bdf1ce68388cc940&scope.project.id=fabb84470909411f80adffac902dea45&role.id=479ed6989eb3488f891ace3940e62ad2 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:39.444690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af133-0a45-4b39-8621-0c32dcec6be1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:39.534932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:39.598895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af133-0a45-4b39-8621-0c32dcec6be1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:39.645713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2d2f7-b694-46e4-a2f3-65e940baeea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:39.646349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d2f7-b694-46e4-a2f3-65e940baeea7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:39.646659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d2f7-b694-46e4-a2f3-65e940baeea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:39.646933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2d2f7-b694-46e4-a2f3-65e940baeea7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:39.647534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2d2f7-b694-46e4-a2f3-65e940baeea7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:39.649457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2d2f7-b694-46e4-a2f3-65e940baeea7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-13f2d2f7-b694-46e4-a2f3-65e940baeea7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:39.659456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:39.661721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:39.664178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 494/989] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Aug 30 14:31:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:39.667964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:39.704335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a61c-c6a5-4949-a006-6e22b5089f20 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:39.704761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a61c-c6a5-4949-a006-6e22b5089f20 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:39.705187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a61c-c6a5-4949-a006-6e22b5089f20 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:39.707375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 495/990] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:39.713695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91599b6-8773-4c8c-8755-ecc74ba06bc9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:39.713970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91599b6-8773-4c8c-8755-ecc74ba06bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:39.714250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91599b6-8773-4c8c-8755-ecc74ba06bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:39.737643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d91599b6-8773-4c8c-8755-ecc74ba06bc9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:39.739255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d91599b6-8773-4c8c-8755-ecc74ba06bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:39.806214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c51d01-be6e-4087-aa94-e7c9b52aba22 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:39.826289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 496/991] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:39.849753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:39.850558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:39.850915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:39.851338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:39.852048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:39.852511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:39.854024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:39.861946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 496/992] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:39.867777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91599b6-8773-4c8c-8755-ecc74ba06bc9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:39.947430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:40.014725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91599b6-8773-4c8c-8755-ecc74ba06bc9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:40.058571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:40.059322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:40.059724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:40.060135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:40.060946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:40.061377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:40.063048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:40.074515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 497/993] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Aug 30 14:31:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:40.076788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:40.088145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:40.147704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:40.241298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ee5fa-52b1-4dd1-b817-328aa94d63bd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:40.279142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ade9-6849-4ec1-8ca9-8ba1c2dc3cb2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:40.307375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:40.309719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b7f5f-b76e-44cd-97c6-dbb074a3a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:40.310856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b7f5f-b76e-44cd-97c6-dbb074a3a7cb None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:40.311111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b7f5f-b76e-44cd-97c6-dbb074a3a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:40.311383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b7f5f-b76e-44cd-97c6-dbb074a3a7cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:40.312989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b7f5f-b76e-44cd-97c6-dbb074a3a7cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:40.316286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b7f5f-b76e-44cd-97c6-dbb074a3a7cb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:40.337868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae394f-b41a-4d10-bef9-0e946c47836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:40.339001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae394f-b41a-4d10-bef9-0e946c47836f None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:40.339473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae394f-b41a-4d10-bef9-0e946c47836f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:40.339956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae394f-b41a-4d10-bef9-0e946c47836f None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:40.341084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae394f-b41a-4d10-bef9-0e946c47836f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:40.343433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae394f-b41a-4d10-bef9-0e946c47836f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:40.354734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 497/994] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:31:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:40.377188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 498/995] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:31:40 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:41.407169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5eae-37d0-4476-860f-337ff23ae63e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:41.407716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5eae-37d0-4476-860f-337ff23ae63e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:41.408083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d5eae-37d0-4476-860f-337ff23ae63e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:41.410727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 498/996] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:41.417242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80299-00fa-41e5-a7ec-f54357819735 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:41.417909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80299-00fa-41e5-a7ec-f54357819735 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:41.417909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b80299-00fa-41e5-a7ec-f54357819735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:41.437783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c8b80299-00fa-41e5-a7ec-f54357819735 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:41.439048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c8b80299-00fa-41e5-a7ec-f54357819735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:41.543440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 499/997] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:42.036703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d5eae-37d0-4476-860f-337ff23ae63e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:42.167401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:42.237490 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d5eae-37d0-4476-860f-337ff23ae63e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:42.317314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d3040-0d41-446c-bda8-544f0ad709ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:42.318280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3040-0d41-446c-bda8-544f0ad709ec None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:42.318788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3040-0d41-446c-bda8-544f0ad709ec None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:42.319255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3040-0d41-446c-bda8-544f0ad709ec None admin] PATH_INFO: `/v3/services/image` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:42.320386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d3040-0d41-446c-bda8-544f0ad709ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:42.322913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d3040-0d41-446c-bda8-544f0ad709ec None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4a0d3040-0d41-446c-bda8-544f0ad709ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:42.339332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:42.341342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:42.344186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 499/998] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Aug 30 14:31:42 2022] GET /identity/v3/services/image => generated 86 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:42.351171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b80299-00fa-41e5-a7ec-f54357819735 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:42.479175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:42.485667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b80299-00fa-41e5-a7ec-f54357819735 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:42.539578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b779903-dc82-434c-919c-99e9061a987f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:42.540418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b779903-dc82-434c-919c-99e9061a987f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:42.540418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b779903-dc82-434c-919c-99e9061a987f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:42.541587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 500/999] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:42.550551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34a1eb-e5d0-45f0-9bd1-19e7b2ad3e19 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:42.551311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34a1eb-e5d0-45f0-9bd1-19e7b2ad3e19 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:42.551958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34a1eb-e5d0-45f0-9bd1-19e7b2ad3e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:42.560557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:42.561549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:42.562027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:42.562852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:42.563946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] RBAC: Adding query filter params (name=image) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:42.565809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:42.568575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:42.579211 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 500/1000] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:42.579727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4c34a1eb-e5d0-45f0-9bd1-19e7b2ad3e19 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:42.581772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c34a1eb-e5d0-45f0-9bd1-19e7b2ad3e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:42.590708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:42.708529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 501/1001] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:42.749262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46112fa-815c-4275-af67-3c757a813b19 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:42.798937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf4a6-18fa-4188-84e6-eb934aa756a4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:42.799411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf4a6-18fa-4188-84e6-eb934aa756a4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:42.800205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf4a6-18fa-4188-84e6-eb934aa756a4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:42.803732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 502/1002] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:42.810747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089821f-dc93-4a4e-b5be-6ce0594600e1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:42.811220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089821f-dc93-4a4e-b5be-6ce0594600e1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:42.811737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089821f-dc93-4a4e-b5be-6ce0594600e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:42.812840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:42.813510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:42.813776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:42.814064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:42.814760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] RBAC: Adding query filter params (type=image) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:42.815063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:42.816428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:42.827841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 501/1003] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:42.848445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0089821f-dc93-4a4e-b5be-6ce0594600e1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:42.850227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0089821f-dc93-4a4e-b5be-6ce0594600e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:42.955080 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:42.977696 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 503/1004] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:43.024517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:43.078040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:43.212606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a038-abf0-4a18-8409-050327fae258 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:43.264173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089821f-dc93-4a4e-b5be-6ce0594600e1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:43.265907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339dc6f-9d92-4aa5-a81d-b3bf88123428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:43.266608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339dc6f-9d92-4aa5-a81d-b3bf88123428 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:43.266952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339dc6f-9d92-4aa5-a81d-b3bf88123428 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:43.267230 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339dc6f-9d92-4aa5-a81d-b3bf88123428 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:43.268506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339dc6f-9d92-4aa5-a81d-b3bf88123428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:43.270018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339dc6f-9d92-4aa5-a81d-b3bf88123428 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:43.272076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 502/1005] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:43.278061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339dc6f-9d92-4aa5-a81d-b3bf88123428 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:43.388325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089821f-dc93-4a4e-b5be-6ce0594600e1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:43.422482 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:43.430263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339dc6f-9d92-4aa5-a81d-b3bf88123428 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:43.445568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:43.446287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:43.446596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:43.446874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:43.447470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:43.449011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:43.459720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:43.460923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:43.463418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 504/1006] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:43.467270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:43.479329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592de9-0dd2-4de9-aeb6-b74ab891d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:43.480277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592de9-0dd2-4de9-aeb6-b74ab891d8bf None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:43.480729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592de9-0dd2-4de9-aeb6-b74ab891d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:43.481009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592de9-0dd2-4de9-aeb6-b74ab891d8bf None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:43.481676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592de9-0dd2-4de9-aeb6-b74ab891d8bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:43.483479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592de9-0dd2-4de9-aeb6-b74ab891d8bf None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:43.518501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 503/1007] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:31:43 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:31:43.559818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:43.641528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10edb4-25c3-4b91-b395-32e683f02c5d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:43.700607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:43.701744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:43.702181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:43.702697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:43.703818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:43.704283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:43.706852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:43.720545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 505/1008] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:43.722296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592de9-0dd2-4de9-aeb6-b74ab891d8bf None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:43.856715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592de9-0dd2-4de9-aeb6-b74ab891d8bf None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:43.895674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:43.896187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:43.896456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:43.896781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:43.897339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:43.897764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:43.899231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:43.905295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 504/1009] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:43.911883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:44.092382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a87e96-929c-4208-90f7-2279aa298463 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:44.123149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:44.152914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848eca-3743-4d50-9618-e113b9f294b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:44.153827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848eca-3743-4d50-9618-e113b9f294b8 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:44.154297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848eca-3743-4d50-9618-e113b9f294b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:44.154796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848eca-3743-4d50-9618-e113b9f294b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:44.156053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848eca-3743-4d50-9618-e113b9f294b8 None admin] RBAC: Adding query filter params (interface=public, service_id=01a7302e9dc6442a89951bdf1e893fba, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:44.156578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848eca-3743-4d50-9618-e113b9f294b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:44.159077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848eca-3743-4d50-9618-e113b9f294b8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:44.173036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 506/1010] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Aug 30 14:31:43 2022] GET /identity/v3/endpoints?service_id=01a7302e9dc6442a89951bdf1e893fba&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:44.174423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:44.194167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:44.298662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a323d55-a272-4e25-8684-d623c4f260eb None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:44.341204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdd963-f043-4c26-9347-fb8ca26793b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:44.341840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd963-f043-4c26-9347-fb8ca26793b3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:44.342150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd963-f043-4c26-9347-fb8ca26793b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:44.342464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd963-f043-4c26-9347-fb8ca26793b3 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:44.343067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdd963-f043-4c26-9347-fb8ca26793b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:44.344459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdd963-f043-4c26-9347-fb8ca26793b3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:44.352303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 505/1011] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:31:44 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:31:45.336535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c05dcb-4141-4ec4-b795-e808cda2fef8 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:45.337317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c05dcb-4141-4ec4-b795-e808cda2fef8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:45.337317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c05dcb-4141-4ec4-b795-e808cda2fef8 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:45.338697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 507/1012] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:45.344194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e570dd-b889-40c5-af3d-2a0b737337ec None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:45.344724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e570dd-b889-40c5-af3d-2a0b737337ec None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:45.344724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e570dd-b889-40c5-af3d-2a0b737337ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:45.366922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f2e570dd-b889-40c5-af3d-2a0b737337ec None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:45.368347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f2e570dd-b889-40c5-af3d-2a0b737337ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:45.471362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 506/1013] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:45 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:45.763426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c05dcb-4141-4ec4-b795-e808cda2fef8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:45.896213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c05dcb-4141-4ec4-b795-e808cda2fef8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:45.936446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92c3c5-4bb1-4a72-a384-a277af14cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:45.937224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c3c5-4bb1-4a72-a384-a277af14cc2f None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:45.937636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c3c5-4bb1-4a72-a384-a277af14cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:45.938043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c3c5-4bb1-4a72-a384-a277af14cc2f None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:45.938916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c3c5-4bb1-4a72-a384-a277af14cc2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:45.940464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c3c5-4bb1-4a72-a384-a277af14cc2f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:45.962660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 508/1014] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:31:45 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:31:46.123247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45d3c-f012-4c5b-b495-9b6e2d39e2bd None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:46.123611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45d3c-f012-4c5b-b495-9b6e2d39e2bd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:46.123948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45d3c-f012-4c5b-b495-9b6e2d39e2bd None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:46.125175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 507/1015] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:46.131314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80230a6-1e2e-4d69-af94-549a6039e8ae None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:46.131645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80230a6-1e2e-4d69-af94-549a6039e8ae None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:46.131904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80230a6-1e2e-4d69-af94-549a6039e8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:46.153630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f80230a6-1e2e-4d69-af94-549a6039e8ae None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:46.154886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f80230a6-1e2e-4d69-af94-549a6039e8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:46.211673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:46.283684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 509/1016] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:46 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:46.721927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b349a-5f05-4ef5-945c-921ad16ae2d1 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:46.722719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b349a-5f05-4ef5-945c-921ad16ae2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:46.722719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b349a-5f05-4ef5-945c-921ad16ae2d1 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:46.723723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 508/1017] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:46.726172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80230a6-1e2e-4d69-af94-549a6039e8ae None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:46.729659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d69dc-ce83-4276-bf80-06865b2f8f02 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:46.729936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d69dc-ce83-4276-bf80-06865b2f8f02 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:46.730206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d69dc-ce83-4276-bf80-06865b2f8f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:46.743789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:46.750653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2b0d69dc-ce83-4276-bf80-06865b2f8f02 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:46.752099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2b0d69dc-ce83-4276-bf80-06865b2f8f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:46.855636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80230a6-1e2e-4d69-af94-549a6039e8ae None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:46.880932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 509/1018] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:46 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:46.898004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8ddd0-857b-4e28-9d71-552a3221ba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:46.899221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8ddd0-857b-4e28-9d71-552a3221ba95 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:46.899610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8ddd0-857b-4e28-9d71-552a3221ba95 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:46.899989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8ddd0-857b-4e28-9d71-552a3221ba95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:46.901334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8ddd0-857b-4e28-9d71-552a3221ba95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:46.902967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8ddd0-857b-4e28-9d71-552a3221ba95 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:46.905062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 510/1019] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:46.910962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d69dc-ce83-4276-bf80-06865b2f8f02 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:47.032984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d69dc-ce83-4276-bf80-06865b2f8f02 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:47.076571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb03369-d1ef-4475-8a68-7bb58d73e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:47.077210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03369-d1ef-4475-8a68-7bb58d73e7b7 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:47.077513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03369-d1ef-4475-8a68-7bb58d73e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:47.077758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03369-d1ef-4475-8a68-7bb58d73e7b7 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:47.078468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb03369-d1ef-4475-8a68-7bb58d73e7b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:47.080120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb03369-d1ef-4475-8a68-7bb58d73e7b7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:47.091318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:47.116559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 510/1020] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:31:46 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:31:47.285773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8ddd0-857b-4e28-9d71-552a3221ba95 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:47.326877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:47.408185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8ddd0-857b-4e28-9d71-552a3221ba95 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:47.454819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:47.455622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:47.456062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:47.456466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:47.457191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:47.458766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:47.469132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:47.471083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:47.472971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 511/1021] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:47.478137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb03369-d1ef-4475-8a68-7bb58d73e7b7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:47.607052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb03369-d1ef-4475-8a68-7bb58d73e7b7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:47.646726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:47.647515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:47.647932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:47.648354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:47.649310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:47.649737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:47.651321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:47.657448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 511/1022] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:47.664512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:47.784302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:47.788899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918435d-f7b2-40dd-8e66-e3a48c393915 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:47.830675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e6d7e-d5d2-46e9-984a-366d1603c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:47.831473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6d7e-d5d2-46e9-984a-366d1603c873 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:47.831892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6d7e-d5d2-46e9-984a-366d1603c873 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:47.832300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6d7e-d5d2-46e9-984a-366d1603c873 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:47.833091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e6d7e-d5d2-46e9-984a-366d1603c873 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:47.833528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e6d7e-d5d2-46e9-984a-366d1603c873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:47.835115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e6d7e-d5d2-46e9-984a-366d1603c873 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:47.841637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 512/1023] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Aug 30 14:31:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:47.847718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:47.915826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:47.971872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bada6f-5966-4dd5-9de4-729085bf7a30 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:48.033687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39362b5d-7001-4732-adc6-85b06061b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:48.034770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362b5d-7001-4732-adc6-85b06061b302 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:48.035265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362b5d-7001-4732-adc6-85b06061b302 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:48.035749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362b5d-7001-4732-adc6-85b06061b302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:48.037005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39362b5d-7001-4732-adc6-85b06061b302 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:48.039821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39362b5d-7001-4732-adc6-85b06061b302 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:48.067006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516dcb-798b-4bf6-91f8-6a2643bb446c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:48.067298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516dcb-798b-4bf6-91f8-6a2643bb446c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:48.067555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516dcb-798b-4bf6-91f8-6a2643bb446c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:48.069013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 513/1024] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:48.077946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995874-0b95-4ada-b117-23b6f5c63d29 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:48.078248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995874-0b95-4ada-b117-23b6f5c63d29 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:48.078655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995874-0b95-4ada-b117-23b6f5c63d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:48.079638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 512/1025] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:31:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:31:48.100893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-dc995874-0b95-4ada-b117-23b6f5c63d29 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:48.103036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dc995874-0b95-4ada-b117-23b6f5c63d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:48.218167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 514/1026] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:48.506988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39362b5d-7001-4732-adc6-85b06061b302 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:48.638313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39362b5d-7001-4732-adc6-85b06061b302 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:48.656217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:48.686589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:48.687273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:48.687551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:48.687820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] PATH_INFO: `/v3/services/image` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:48.688428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:48.689917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:48.701057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:48.703318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:48.704962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:48.709397 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc995874-0b95-4ada-b117-23b6f5c63d29 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:48.710497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 513/1027] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Aug 30 14:31:48 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:48.833961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:48.848581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc995874-0b95-4ada-b117-23b6f5c63d29 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:48.894741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:48.895281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:48.895642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:48.895842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:48.896507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] RBAC: Adding query filter params (name=image) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:48.896983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:48.899128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:48.905650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 515/1028] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:48.911567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:49.139162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539e93d-6ad8-4d69-8a46-41cce093e293 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:49.211437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861aaff-d458-4f3d-9bd2-bd733995067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:49.212655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861aaff-d458-4f3d-9bd2-bd733995067a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:49.213144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861aaff-d458-4f3d-9bd2-bd733995067a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:49.213612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861aaff-d458-4f3d-9bd2-bd733995067a None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:49.214820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861aaff-d458-4f3d-9bd2-bd733995067a None admin] RBAC: Adding query filter params (type=image) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:49.215349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861aaff-d458-4f3d-9bd2-bd733995067a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:49.218204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861aaff-d458-4f3d-9bd2-bd733995067a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:49.228096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 514/1029] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:49.235046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:49.392242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5a0f6-ec44-4bba-8e8b-7689e48d593f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:49.392785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5a0f6-ec44-4bba-8e8b-7689e48d593f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:49.393303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5a0f6-ec44-4bba-8e8b-7689e48d593f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:49.395685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 515/1030] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:49.401553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e48a3-9d78-4fed-a3ac-7e01e01ee7b8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:49.402019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e48a3-9d78-4fed-a3ac-7e01e01ee7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:49.402295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e48a3-9d78-4fed-a3ac-7e01e01ee7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:49.426506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f07e48a3-9d78-4fed-a3ac-7e01e01ee7b8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:49.427780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f07e48a3-9d78-4fed-a3ac-7e01e01ee7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:49.432244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae410-5246-46fd-adae-d27ae6263588 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:49.487386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:49.510014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:49.512893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:49.513195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:49.513461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:49.514229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] RBAC: Adding query filter params (interface=public, service_id=1810c8a0366541a499f37e7595011a71, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:49.514636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:49.516556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:49.529420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 516/1031] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Aug 30 14:31:49 2022] GET /identity/v3/endpoints?service_id=1810c8a0366541a499f37e7595011a71&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:49.534874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:49.546698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 516/1032] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:49.565711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:49.680542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5a867-afcb-49de-af65-97cda0cd4430 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:49.722086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c85f4-b9ba-4f72-aaf7-9e534f82879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:49.722735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c85f4-b9ba-4f72-aaf7-9e534f82879d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:49.723043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c85f4-b9ba-4f72-aaf7-9e534f82879d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:49.723290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c85f4-b9ba-4f72-aaf7-9e534f82879d None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:49.723880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c85f4-b9ba-4f72-aaf7-9e534f82879d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:49.725282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c85f4-b9ba-4f72-aaf7-9e534f82879d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:49.733371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 517/1033] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:31:49 2022] GET /identity/v3/services => generated 1957 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:31:50.014908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e48a3-9d78-4fed-a3ac-7e01e01ee7b8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:50.198795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e48a3-9d78-4fed-a3ac-7e01e01ee7b8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:50.264509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3668b-aa66-4a62-bb2e-8750450a1f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:50.265247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3668b-aa66-4a62-bb2e-8750450a1f22 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:50.265521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3668b-aa66-4a62-bb2e-8750450a1f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:50.265775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3668b-aa66-4a62-bb2e-8750450a1f22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:50.277696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3668b-aa66-4a62-bb2e-8750450a1f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-70d3668b-aa66-4a62-bb2e-8750450a1f22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:50.282550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:50.286927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:50.287798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 517/1034] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:50.293623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c85f4-b9ba-4f72-aaf7-9e534f82879d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:50.387947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:50.417480 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c85f4-b9ba-4f72-aaf7-9e534f82879d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:50.457998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:50.458659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:50.458924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:50.459204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:50.459868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:50.460611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:50.461837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:50.471950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 518/1035] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:50.478845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3668b-aa66-4a62-bb2e-8750450a1f22 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:50.530270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:50.628704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3668b-aa66-4a62-bb2e-8750450a1f22 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:50.699100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5c7a5-1228-4a08-bdde-1b7971e40e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:50.700569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5c7a5-1228-4a08-bdde-1b7971e40e34 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:50.701032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5c7a5-1228-4a08-bdde-1b7971e40e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:50.701321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5c7a5-1228-4a08-bdde-1b7971e40e34 None admin] PATH_INFO: `/v3/users/1d88d3990fc44d7fb0499295c327edf0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:50.730035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5c7a5-1228-4a08-bdde-1b7971e40e34 None admin] RBAC: Authorizing `identity:get_user(user_id=1d88d3990fc44d7fb0499295c327edf0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:50.732923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5c7a5-1228-4a08-bdde-1b7971e40e34 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:50.736492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 518/1036] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:31:50 2022] GET /identity/v3/users/1d88d3990fc44d7fb0499295c327edf0 => generated 285 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:50.746353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:50.871503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61fbdc-9963-4f77-920f-a0b8b85a67b3 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:50.871898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61fbdc-9963-4f77-920f-a0b8b85a67b3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:50.872395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61fbdc-9963-4f77-920f-a0b8b85a67b3 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:50.875069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 519/1037] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:50.882100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ccfd1-93d9-4d97-a5cf-d096fdbf9814 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:50.883309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ccfd1-93d9-4d97-a5cf-d096fdbf9814 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:50.883805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ccfd1-93d9-4d97-a5cf-d096fdbf9814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:50.917592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a11ccfd1-93d9-4d97-a5cf-d096fdbf9814 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:50.919737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a11ccfd1-93d9-4d97-a5cf-d096fdbf9814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:50.938003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe588e-107b-4063-9fbf-f3f4bde3a195 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:51.003906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b141-efd3-4279-9969-9243710b44f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:51.005068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b141-efd3-4279-9969-9243710b44f1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:51.005568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b141-efd3-4279-9969-9243710b44f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:51.006036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41b141-efd3-4279-9969-9243710b44f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:51.032349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:51.044238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 520/1038] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:51.102242 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41b141-efd3-4279-9969-9243710b44f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:51.103827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41b141-efd3-4279-9969-9243710b44f1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:51.222833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 519/1039] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:31:51.224624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ccfd1-93d9-4d97-a5cf-d096fdbf9814 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:51.262467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:51.403611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b141-efd3-4279-9969-9243710b44f1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:51.428558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ccfd1-93d9-4d97-a5cf-d096fdbf9814 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:51.473111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:51.496407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911dd5e-a70d-4531-aed0-1237d7676972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:51.497675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911dd5e-a70d-4531-aed0-1237d7676972 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:51.498156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911dd5e-a70d-4531-aed0-1237d7676972 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:51.502106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911dd5e-a70d-4531-aed0-1237d7676972 None admin] PATH_INFO: `/v3/projects/bc92f78f699e4d86a7923e8d3d83094b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:51.502106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911dd5e-a70d-4531-aed0-1237d7676972 None admin] RBAC: Authorizing `identity:get_project(project_id=bc92f78f699e4d86a7923e8d3d83094b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:51.506012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911dd5e-a70d-4531-aed0-1237d7676972 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:51.517964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 521/1040] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:31:51 2022] GET /identity/v3/projects/bc92f78f699e4d86a7923e8d3d83094b => generated 311 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:51.519447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911dd5e-a70d-4531-aed0-1237d7676972 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:51.575435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41b141-efd3-4279-9969-9243710b44f1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:51.635237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132c62-f5e2-44a7-8fa4-d0a0677fc66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:51.636298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132c62-f5e2-44a7-8fa4-d0a0677fc66a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:51.636772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132c62-f5e2-44a7-8fa4-d0a0677fc66a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:51.637236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132c62-f5e2-44a7-8fa4-d0a0677fc66a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:51.656178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:51.658066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5132c62-f5e2-44a7-8fa4-d0a0677fc66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d5132c62-f5e2-44a7-8fa4-d0a0677fc66a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:51.668945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:51.670880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:51.672562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:51.679367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 520/1041] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Aug 30 14:31:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:51.681360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911dd5e-a70d-4531-aed0-1237d7676972 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:51.681676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132c62-f5e2-44a7-8fa4-d0a0677fc66a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:51.729263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce370b82-17e5-43d7-b20d-eecd189c520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:51.730213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370b82-17e5-43d7-b20d-eecd189c520f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:51.730771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370b82-17e5-43d7-b20d-eecd189c520f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:51.731166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce370b82-17e5-43d7-b20d-eecd189c520f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:51.732557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce370b82-17e5-43d7-b20d-eecd189c520f None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=bc92f78f699e4d86a7923e8d3d83094b, user.id=1d88d3990fc44d7fb0499295c327edf0) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:51.733035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce370b82-17e5-43d7-b20d-eecd189c520f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:51.736099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce370b82-17e5-43d7-b20d-eecd189c520f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:51.753775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 522/1042] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:51 2022] GET /identity/v3/role_assignments?user.id=1d88d3990fc44d7fb0499295c327edf0&scope.project.id=bc92f78f699e4d86a7923e8d3d83094b&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:51.893344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132c62-f5e2-44a7-8fa4-d0a0677fc66a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:51.899080 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:51.966251 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:51.966577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254dd0c-c3d3-4bcd-ac27-ed5f64e16086 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:51.966767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254dd0c-c3d3-4bcd-ac27-ed5f64e16086 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:51.966900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:51.967306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254dd0c-c3d3-4bcd-ac27-ed5f64e16086 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:51.967457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:51.967457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:51.968122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:51.968421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:51.969880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 523/1043] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:31:51.970064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:51.978715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090a36-7374-41c9-8437-97d85f72fcf9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:51.979102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090a36-7374-41c9-8437-97d85f72fcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:51.979520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090a36-7374-41c9-8437-97d85f72fcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:51.982806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 521/1044] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Aug 30 14:31:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:51.988971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:52.018494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-05090a36-7374-41c9-8437-97d85f72fcf9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:52.020665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-05090a36-7374-41c9-8437-97d85f72fcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:52.130022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 524/1045] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:52.147252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff9e9-d782-4e70-a754-fe08a2c6bbcd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:52.211070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:52.212715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:52.213557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:52.214290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:52.235917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:52.238958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:52.267483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:52.269567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:52.271850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:52.271850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:52.271850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:52.274815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 522/1046] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:52.283762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090a36-7374-41c9-8437-97d85f72fcf9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:52.440079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:52.476697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090a36-7374-41c9-8437-97d85f72fcf9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:52.548046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:52.549590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:52.550356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:52.551134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:52.552847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:52.553330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:52.554062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:52.556354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:52.577529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:52.586726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 525/1047] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:52.589565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:52.710030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0371290-6375-4e59-8d27-dce3b54f4840 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:52.751404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:52.752052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:52.752432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:52.752580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:52.753170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:52.754643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:52.764648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:52.766804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:52.769010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 523/1048] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Aug 30 14:31:52 2022] GET /identity/v3/services/image => generated 86 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:52.776513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:52.779174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72145f67-974d-40ac-a756-90f10df7c321 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:52.846858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:52.848067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:52.848984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:52.849820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:52.865447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:52.867659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:52.872348 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:52.889589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:52.891477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:52.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 526/1049] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:31:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:52.897829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:52.898913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:52.930526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a53c3-244f-4155-98c8-11d73063f2f3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:52.977824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:52.979132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:52.979931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:52.980746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:52.981960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] RBAC: Adding query filter params (name=image) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:52.982938 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:52.986884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:52.997562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 524/1050] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:53.006121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:53.044866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a03db-ee27-4541-b2ac-057ab646b742 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:53.084243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:53.084859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:53.085239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:53.085504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:53.086235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:53.086562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:53.088007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:53.108273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 527/1051] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:31:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:53.114421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:53.167975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd7e06-a06b-4321-be06-d1eb32146c7c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:53.185146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:53.224053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:53.224752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:53.225034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:53.225851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:53.226605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] RBAC: Adding query filter params (type=image) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:53.226906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:53.228727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:53.241697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 525/1052] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:53.243009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:53.262210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e599012-fd06-45c1-96a3-5bda1e9dc64b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:53.263246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:53.329407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340876-c598-4335-acb8-88ce685698a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:53.330459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340876-c598-4335-acb8-88ce685698a1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:53.330932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340876-c598-4335-acb8-88ce685698a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:53.331402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340876-c598-4335-acb8-88ce685698a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:53.433359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c488c-cada-4068-81cc-8404ad8ddf8a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:53.456998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f340876-c598-4335-acb8-88ce685698a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:53.460620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f340876-c598-4335-acb8-88ce685698a1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:53.476927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2908a0-c0d0-4b99-8108-1be4fd088ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:53.477599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2908a0-c0d0-4b99-8108-1be4fd088ad8 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:53.477878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2908a0-c0d0-4b99-8108-1be4fd088ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:53.478145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2908a0-c0d0-4b99-8108-1be4fd088ad8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:53.478873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2908a0-c0d0-4b99-8108-1be4fd088ad8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:53.480310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2908a0-c0d0-4b99-8108-1be4fd088ad8 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:53.526418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 526/1053] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:31:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:31:53.571000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:53.649752 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 528/1054] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:31:53.659006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2908a0-c0d0-4b99-8108-1be4fd088ad8 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:53.765165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:53.806860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1b53-8626-4ac0-946b-9e4ad1cb6d53 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:53.807235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1b53-8626-4ac0-946b-9e4ad1cb6d53 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:53.807405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1b53-8626-4ac0-946b-9e4ad1cb6d53 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:53.809084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 529/1055] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:53.814802 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8cb2d-05fa-4992-a642-5f66de90f46a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:53.815070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8cb2d-05fa-4992-a642-5f66de90f46a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:53.815378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8cb2d-05fa-4992-a642-5f66de90f46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:53.829575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2908a0-c0d0-4b99-8108-1be4fd088ad8 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:53.844069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7bd8cb2d-05fa-4992-a642-5f66de90f46a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:53.846191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7bd8cb2d-05fa-4992-a642-5f66de90f46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:53.873105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:53.873907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:53.874368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:53.874713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:53.892579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:53.894087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:53.910437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:53.911740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:53.912821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:53.912821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:53.912821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:53.912821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 527/1056] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:53.917595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:53.939335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 530/1057] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:54.055260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc585f2-f636-41f8-9edc-c21751f83a26 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:54.071943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:54.097518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:54.098165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:54.098503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:54.098771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:54.099414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:54.099716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:54.102053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:54.122716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 528/1058] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:54.124475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8cb2d-05fa-4992-a642-5f66de90f46a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:54.241619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:54.253328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:54.265648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8cb2d-05fa-4992-a642-5f66de90f46a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:54.321236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:54.321981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:54.322270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:54.322548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:54.330680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:54.332154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:54.346513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:54.347535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:54.348454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 531/1059] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:54.357597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:54.396293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a790e8-d8c8-4dab-b435-eddcd916b9ac None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:54.441181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875085a-5fb0-4c95-a41b-9db6ea9ed8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:54.442213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875085a-5fb0-4c95-a41b-9db6ea9ed8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:54.442689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875085a-5fb0-4c95-a41b-9db6ea9ed8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:54.443129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875085a-5fb0-4c95-a41b-9db6ea9ed8d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:54.462769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875085a-5fb0-4c95-a41b-9db6ea9ed8d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-a875085a-5fb0-4c95-a41b-9db6ea9ed8d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:54.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:54.474155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:54.480526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 529/1060] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:54.482259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875085a-5fb0-4c95-a41b-9db6ea9ed8d4 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:54.521155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b6de5-a729-4b90-ba1e-55f83dcdb56e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:54.544564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:54.581236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:54.582195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:54.582656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:54.583134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:54.584427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:54.584959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:54.587989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:54.618942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 532/1061] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:54.626210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:54.639315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875085a-5fb0-4c95-a41b-9db6ea9ed8d4 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:54.644604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:54.696016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:54.696998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:54.697434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:54.697868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:54.699004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:54.699478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:54.702276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:54.721717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 530/1062] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:31:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:54.729947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:54.823526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbb4d3-e3fc-4c98-b16b-6e0c3cce5231 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:54.870972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:54.871649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:54.871963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:54.872241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:54.872992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] RBAC: Adding query filter params (role.id=479ed6989eb3488f891ace3940e62ad2, scope.project.id=fabb84470909411f80adffac902dea45, user.id=906464ed50294dc481c4d1d570a5195b) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:54.873293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:54.874830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:54.882785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 533/1063] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:54 2022] GET /identity/v3/role_assignments?user.id=906464ed50294dc481c4d1d570a5195b&scope.project.id=fabb84470909411f80adffac902dea45&role.id=479ed6989eb3488f891ace3940e62ad2 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:54.917072 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:54.926607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0334f-fc75-4ce3-ba9f-8cb26bec9ad7 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:54.973113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72db3-4f66-4437-9748-3102dddb3384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:54.973795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72db3-4f66-4437-9748-3102dddb3384 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:54.974066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72db3-4f66-4437-9748-3102dddb3384 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:54.974330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada72db3-4f66-4437-9748-3102dddb3384 None admin] PATH_INFO: `/v3/users/1d88d3990fc44d7fb0499295c327edf0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:54.975823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada72db3-4f66-4437-9748-3102dddb3384 None admin] RBAC: Authorizing `identity:get_user(user_id=1d88d3990fc44d7fb0499295c327edf0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:54.977409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada72db3-4f66-4437-9748-3102dddb3384 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:54.986437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 531/1064] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:31:54 2022] GET /identity/v3/users/1d88d3990fc44d7fb0499295c327edf0 => generated 285 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:54.988870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:55.083859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:55.121385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa0eed-0ff5-44b6-bf3c-41c1d212fd9b None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:55.170105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8b85-f571-453a-8883-8aadc2e1ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:55.171187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8b85-f571-453a-8883-8aadc2e1ff6c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:55.171652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8b85-f571-453a-8883-8aadc2e1ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:55.172099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8b85-f571-453a-8883-8aadc2e1ff6c None admin] PATH_INFO: `/v3/projects/bc92f78f699e4d86a7923e8d3d83094b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:55.174094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8b85-f571-453a-8883-8aadc2e1ff6c None admin] RBAC: Authorizing `identity:get_project(project_id=bc92f78f699e4d86a7923e8d3d83094b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:55.176875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8b85-f571-453a-8883-8aadc2e1ff6c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:55.180215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 534/1065] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:31:54 2022] GET /identity/v3/projects/bc92f78f699e4d86a7923e8d3d83094b => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:55.189737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72db3-4f66-4437-9748-3102dddb3384 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:55.384021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada72db3-4f66-4437-9748-3102dddb3384 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:55.452523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b6c25-e395-4f3a-91d3-ad7fe871080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:55.453678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b6c25-e395-4f3a-91d3-ad7fe871080a None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:55.454161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b6c25-e395-4f3a-91d3-ad7fe871080a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:55.454686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b6c25-e395-4f3a-91d3-ad7fe871080a None admin] PATH_INFO: `/v3/projects/bc92f78f699e4d86a7923e8d3d83094b/users/1d88d3990fc44d7fb0499295c327edf0/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:55.458429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b6c25-e395-4f3a-91d3-ad7fe871080a None admin] RBAC: Authorizing `identity:create_grant(project_id=bc92f78f699e4d86a7923e8d3d83094b, user_id=1d88d3990fc44d7fb0499295c327edf0, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:55.461419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b6c25-e395-4f3a-91d3-ad7fe871080a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:55.490340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 532/1066] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:31:55 2022] PUT /identity/v3/projects/bc92f78f699e4d86a7923e8d3d83094b/users/1d88d3990fc44d7fb0499295c327edf0/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:31:55.823143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10c05-d211-4177-bc0b-43100b506b3e None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:55.824015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10c05-d211-4177-bc0b-43100b506b3e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:55.824015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10c05-d211-4177-bc0b-43100b506b3e None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:55.825642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 535/1067] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:55.831156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005a809-8888-4a68-85b6-a4f82c089f16 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:55.831800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005a809-8888-4a68-85b6-a4f82c089f16 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:55.831800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005a809-8888-4a68-85b6-a4f82c089f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:55.851979 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a005a809-8888-4a68-85b6-a4f82c089f16 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:55.853205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a005a809-8888-4a68-85b6-a4f82c089f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:55.875803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:55.939326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 533/1068] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:31:56.201652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a10c05-d211-4177-bc0b-43100b506b3e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:56.373872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a10c05-d211-4177-bc0b-43100b506b3e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:56.441037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaefad-2f42-4a5b-9740-0c2caa5c167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:56.442606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaefad-2f42-4a5b-9740-0c2caa5c167d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:56.443318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaefad-2f42-4a5b-9740-0c2caa5c167d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:56.444022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaefad-2f42-4a5b-9740-0c2caa5c167d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:56.467639 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:56.587658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaefad-2f42-4a5b-9740-0c2caa5c167d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:56.590311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaefad-2f42-4a5b-9740-0c2caa5c167d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:56.774520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 536/1069] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:31:56.780405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005a809-8888-4a68-85b6-a4f82c089f16 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:56.976181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005a809-8888-4a68-85b6-a4f82c089f16 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:57.041947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509d93-4606-415b-83d5-f620ce809d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:57.043017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509d93-4606-415b-83d5-f620ce809d28 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:57.043485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509d93-4606-415b-83d5-f620ce809d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:57.043959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509d93-4606-415b-83d5-f620ce809d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:57.062740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32509d93-4606-415b-83d5-f620ce809d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:57.065458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32509d93-4606-415b-83d5-f620ce809d28 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-32509d93-4606-415b-83d5-f620ce809d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:57.098259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:57.100356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:57.103017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:57.103017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:57.103017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:57.106648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 534/1070] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:57.114055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaefad-2f42-4a5b-9740-0c2caa5c167d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:57.191730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:57.280405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622c099-7ab1-4a85-a97a-34064f2c9627 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:57.280863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622c099-7ab1-4a85-a97a-34064f2c9627 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:57.281326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622c099-7ab1-4a85-a97a-34064f2c9627 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:57.283818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 535/1071] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:57.289671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d40c9-67fa-4db8-a6a9-df79c057a91e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:57.290272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d40c9-67fa-4db8-a6a9-df79c057a91e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:57.290813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d40c9-67fa-4db8-a6a9-df79c057a91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:57.293866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaefad-2f42-4a5b-9740-0c2caa5c167d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:57.310551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:57.320380 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-dc6d40c9-67fa-4db8-a6a9-df79c057a91e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:57.322787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dc6d40c9-67fa-4db8-a6a9-df79c057a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:57.356345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:57.357198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:57.357629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:57.358060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:57.359017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:57.359522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:57.361873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:57.390419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 537/1072] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:57.440418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 536/1073] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:57.757980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:57.806088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950db7b-3da8-4590-b896-a16dd622a863 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:57.806704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950db7b-3da8-4590-b896-a16dd622a863 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:57.806974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950db7b-3da8-4590-b896-a16dd622a863 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:57.809009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 537/1074] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:31:57.815079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1e713-d9ad-41c6-aab5-b29e85aef65b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:57.815356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1e713-d9ad-41c6-aab5-b29e85aef65b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:57.815625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1e713-d9ad-41c6-aab5-b29e85aef65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:57.834507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-61c1e713-d9ad-41c6-aab5-b29e85aef65b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:31:57.836198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-61c1e713-d9ad-41c6-aab5-b29e85aef65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:31:57.893244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:57.896956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9257b8-4bb8-4338-9669-32499dc17f9a None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:57.916054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 538/1075] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:31:57.936019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b36f-56e5-4aa8-a437-0207f990f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:57.936870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b36f-56e5-4aa8-a437-0207f990f010 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:57.937182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b36f-56e5-4aa8-a437-0207f990f010 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:57.937531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b36f-56e5-4aa8-a437-0207f990f010 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:57.949242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5b36f-56e5-4aa8-a437-0207f990f010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7ab5b36f-56e5-4aa8-a437-0207f990f010 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:57.954356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:57.956238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:31:57.957977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:57.959670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 538/1076] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Aug 30 14:31:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:57.962312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1e713-d9ad-41c6-aab5-b29e85aef65b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.061827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:58.129150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1e713-d9ad-41c6-aab5-b29e85aef65b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:58.194679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b36f-56e5-4aa8-a437-0207f990f010 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.198695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:58.198695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:58.199008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:58.199387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:58.200953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:58.201487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:58.204172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:58.226091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 539/1077] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Aug 30 14:31:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:58.227657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.315046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b36f-56e5-4aa8-a437-0207f990f010 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:58.363329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5e82c-fac7-44eb-b0b4-e4bcc9b959ab None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:58.366313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a722fe7-1e8f-4f07-8765-33f1f904f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:58.367113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722fe7-1e8f-4f07-8765-33f1f904f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:58.367678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722fe7-1e8f-4f07-8765-33f1f904f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:58.368030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722fe7-1e8f-4f07-8765-33f1f904f4e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:58.383041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a722fe7-1e8f-4f07-8765-33f1f904f4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-2a722fe7-1e8f-4f07-8765-33f1f904f4e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:31:58.388775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:58.390891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:31:58.392743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 539/1078] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:58.401179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a722fe7-1e8f-4f07-8765-33f1f904f4e1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.406584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:58.420050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:58.420966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:58.421385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:58.421836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:58.429346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:58.436988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:58.438924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:58.457560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:58.459687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:58.461599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:58.461599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:58.461599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:58.461599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 540/1079] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:58.465439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.546180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a722fe7-1e8f-4f07-8765-33f1f904f4e1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:58.588120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:58.588648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:58.588941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:58.589207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:58.589877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:58.590172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:58.591613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:58.602184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 540/1080] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:31:58.607742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc411b4-5bad-4423-9cbd-8d180fb4e47b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:58.608183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.667602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:58.668625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:58.669104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:58.669569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:58.670697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:58.671210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:58.673788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:58.694099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 541/1081] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:58.699487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.703424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:58.734617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64f70d-7366-4fe1-bf39-c74be3bc6e5c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:58.748524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:58.782277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56638bd-baae-4ec5-9cbb-ab531c808925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:58.783117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56638bd-baae-4ec5-9cbb-ab531c808925 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:58.783475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56638bd-baae-4ec5-9cbb-ab531c808925 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:58.783880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56638bd-baae-4ec5-9cbb-ab531c808925 None admin] PATH_INFO: `/v3/users/1d88d3990fc44d7fb0499295c327edf0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:58.785220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56638bd-baae-4ec5-9cbb-ab531c808925 None admin] RBAC: Authorizing `identity:get_user(user_id=1d88d3990fc44d7fb0499295c327edf0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:58.786871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56638bd-baae-4ec5-9cbb-ab531c808925 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:58.788762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 541/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:31:58 2022] GET /identity/v3/users/1d88d3990fc44d7fb0499295c327edf0 => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:58.795309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56638bd-baae-4ec5-9cbb-ab531c808925 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.821059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387ae92-16e7-4d5b-993b-30220c49f7ed None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:58.873931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:58.874651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:58.875020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:58.875379 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:58.884259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:58.885939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:31:58.900063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:58.902447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:58.904420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 542/1083] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:31:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:58.907691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:58.931295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56638bd-baae-4ec5-9cbb-ab531c808925 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:58.973232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f2ac2-79d4-44ad-b597-6f4492f93e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:58.974036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f2ac2-79d4-44ad-b597-6f4492f93e14 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:58.974412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f2ac2-79d4-44ad-b597-6f4492f93e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:58.974760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f2ac2-79d4-44ad-b597-6f4492f93e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:58.996763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:59.021440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:59.025300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4334f-b1d0-4690-9c83-2d2039c03a0e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:59.055937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f2ac2-79d4-44ad-b597-6f4492f93e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:59.058367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f2ac2-79d4-44ad-b597-6f4492f93e14 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:59.073768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:59.075179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:59.075537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:59.076122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:59.077454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:59.077997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:59.080736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:59.114315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 543/1084] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:31:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:59.120271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:59.204419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 542/1085] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:31:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:31:59.211231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f2ac2-79d4-44ad-b597-6f4492f93e14 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:59.245537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3da73-7004-49f8-b7d3-8fcb1dc0645f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:59.276003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:59.286074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:59.286762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:59.287038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:59.287308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:59.298446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:59.299943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:31:59.315622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:59.317302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:31:59.318243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:31:59.318243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:31:59.318243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:59.318243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 544/1086] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:31:59.322988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:59.336988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:59.365021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f2ac2-79d4-44ad-b597-6f4492f93e14 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:59.409698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ef58f-5d1a-4134-8ae4-8099d91349e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:59.410689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef58f-5d1a-4134-8ae4-8099d91349e0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:59.411094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef58f-5d1a-4134-8ae4-8099d91349e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:59.411486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ef58f-5d1a-4134-8ae4-8099d91349e0 None admin] PATH_INFO: `/v3/projects/bc92f78f699e4d86a7923e8d3d83094b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:59.413080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ef58f-5d1a-4134-8ae4-8099d91349e0 None admin] RBAC: Authorizing `identity:get_project(project_id=bc92f78f699e4d86a7923e8d3d83094b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:59.415279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ef58f-5d1a-4134-8ae4-8099d91349e0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:59.417112 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 543/1087] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:31:59 2022] GET /identity/v3/projects/bc92f78f699e4d86a7923e8d3d83094b => generated 311 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:59.423404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ef58f-5d1a-4134-8ae4-8099d91349e0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:59.466899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb214a88-e81c-42ff-822c-c8f68cb5f44c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:59.513772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:59.514429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:59.514708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:59.514972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:59.515623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:59.515922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:59.517332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:59.542848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 545/1088] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:59.550721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:59.564078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ef58f-5d1a-4134-8ae4-8099d91349e0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:59.590864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:59.618293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:59.619416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:59.619880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:59.620336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:59.621659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=bc92f78f699e4d86a7923e8d3d83094b, user.id=1d88d3990fc44d7fb0499295c327edf0) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:31:59.622227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:59.624918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:59.650420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 544/1089] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:31:59 2022] GET /identity/v3/role_assignments?user.id=1d88d3990fc44d7fb0499295c327edf0&scope.project.id=bc92f78f699e4d86a7923e8d3d83094b&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:31:59.655292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:31:59.717517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b69b-9dff-43af-b5a4-8353bc90c979 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:31:59.785129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:31:59.786227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:31:59.786742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:31:59.787200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:31:59.796604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:31:59.798269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:31:59.814662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:31:59.816649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:31:59.818724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 546/1090] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:31:59.825541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:31:59.959328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8c85-1708-4230-bbe2-23e64a4e805c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:00.000282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e4710-af4c-46d7-8a80-dcfff9be283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:00.000893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4710-af4c-46d7-8a80-dcfff9be283c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:00.001203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4710-af4c-46d7-8a80-dcfff9be283c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:00.001506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4710-af4c-46d7-8a80-dcfff9be283c None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:00.002280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4710-af4c-46d7-8a80-dcfff9be283c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:00.002646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4710-af4c-46d7-8a80-dcfff9be283c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:00.004184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4710-af4c-46d7-8a80-dcfff9be283c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:00.019324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 545/1091] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:00.026131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:00.158420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c93a-ae0d-46ee-a249-9421dbbf48d3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:00.203626 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:00.214327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5454-ef1f-4c2e-b853-dea30a328423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:00.215528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5454-ef1f-4c2e-b853-dea30a328423 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:00.216026 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5454-ef1f-4c2e-b853-dea30a328423 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:00.216550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5454-ef1f-4c2e-b853-dea30a328423 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/906464ed50294dc481c4d1d570a5195b/roles/479ed6989eb3488f891ace3940e62ad2` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:00.220437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5454-ef1f-4c2e-b853-dea30a328423 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=906464ed50294dc481c4d1d570a5195b, role_id=479ed6989eb3488f891ace3940e62ad2)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:00.223283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5454-ef1f-4c2e-b853-dea30a328423 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:00.245497 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 547/1092] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:32:00 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/906464ed50294dc481c4d1d570a5195b/roles/479ed6989eb3488f891ace3940e62ad2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:32:01.652699 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22147a14-cce9-4d3f-89c7-551832d6762b None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:01.653327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22147a14-cce9-4d3f-89c7-551832d6762b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:01.653327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22147a14-cce9-4d3f-89c7-551832d6762b None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:01.654806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 546/1093] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:01.660303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06d8a-c5fc-45ab-835f-1373730e9e2e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:01.660837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06d8a-c5fc-45ab-835f-1373730e9e2e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:01.660837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06d8a-c5fc-45ab-835f-1373730e9e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:01.681049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b2a06d8a-c5fc-45ab-835f-1373730e9e2e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:01.682186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b2a06d8a-c5fc-45ab-835f-1373730e9e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:01.757876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 548/1094] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:02.020621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22147a14-cce9-4d3f-89c7-551832d6762b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:02.068255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:02.142934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22147a14-cce9-4d3f-89c7-551832d6762b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:02.181188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70209c64-69f5-46b4-b922-18937514ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:02.181822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209c64-69f5-46b4-b922-18937514ae9c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:02.182089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209c64-69f5-46b4-b922-18937514ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:02.182361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209c64-69f5-46b4-b922-18937514ae9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:02.183534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70209c64-69f5-46b4-b922-18937514ae9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:02.184980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70209c64-69f5-46b4-b922-18937514ae9c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:02.186609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 547/1095] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:02.196460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a06d8a-c5fc-45ab-835f-1373730e9e2e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:02.228837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb84c3-5acd-4ef0-8824-812aca58544a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:02.229242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb84c3-5acd-4ef0-8824-812aca58544a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:02.229347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb84c3-5acd-4ef0-8824-812aca58544a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:02.230728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 548/1096] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:02.236025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b710d7-7144-443a-8ba6-9772d7048de7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:02.236305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b710d7-7144-443a-8ba6-9772d7048de7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:02.236582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b710d7-7144-443a-8ba6-9772d7048de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:02.255980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-25b710d7-7144-443a-8ba6-9772d7048de7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:02.257250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-25b710d7-7144-443a-8ba6-9772d7048de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:02.338040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 549/1097] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:32:02.342682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a06d8a-c5fc-45ab-835f-1373730e9e2e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:02.362158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:02.378172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960347c2-161a-4640-a33a-d1466b3e1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:02.378820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960347c2-161a-4640-a33a-d1466b3e1c1c None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:02.379097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960347c2-161a-4640-a33a-d1466b3e1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:02.379362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960347c2-161a-4640-a33a-d1466b3e1c1c None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:02.380011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960347c2-161a-4640-a33a-d1466b3e1c1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:02.381440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960347c2-161a-4640-a33a-d1466b3e1c1c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:02.406310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 549/1098] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:32:02 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:32:02.610357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b710d7-7144-443a-8ba6-9772d7048de7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:02.663718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:02.730738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b710d7-7144-443a-8ba6-9772d7048de7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:02.767823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16dda7-356d-41ec-9997-fcb2a9dc0cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:02.768468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dda7-356d-41ec-9997-fcb2a9dc0cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:02.768879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dda7-356d-41ec-9997-fcb2a9dc0cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:02.769156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16dda7-356d-41ec-9997-fcb2a9dc0cc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:02.788328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16dda7-356d-41ec-9997-fcb2a9dc0cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-ff16dda7-356d-41ec-9997-fcb2a9dc0cc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:32:02.793184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:02.798920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:02.799772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 550/1099] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Aug 30 14:32:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:02.801804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960347c2-161a-4640-a33a-d1466b3e1c1c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:02.921190 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960347c2-161a-4640-a33a-d1466b3e1c1c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:02.959676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:02.960367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:02.960650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:02.960914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:02.961594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:02.961891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:02.963377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:02.972552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 550/1100] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Aug 30 14:32:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:02.979806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16dda7-356d-41ec-9997-fcb2a9dc0cc8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:03.087104 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:03.093357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16dda7-356d-41ec-9997-fcb2a9dc0cc8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:03.131187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:03.132101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:03.132101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:03.132437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:03.143682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:03.145155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:32:03.161729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:03.163317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:32:03.164441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:32:03.164441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:32:03.164441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:03.164441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 551/1101] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:03.169361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:03.236273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:03.315300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8889b7-5bdf-4e05-b42e-87f7b23764b6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:03.363097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:03.363831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:03.364106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:03.364367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:03.365009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:03.365301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:03.366860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:03.380335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 551/1102] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:03.386597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:03.510908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc129403-ac05-4620-8b50-500e2d4413f0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:03.552858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:03.553492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:03.553768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:03.554032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:03.564657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:03.566313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:32:03.580342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:03.581673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:03.582812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 552/1103] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Aug 30 14:32:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:03.587810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:03.698474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:03.706160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8191b-e28a-4755-b849-95bfa62f70ec None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:03.745349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:03.746128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:03.746548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:03.746883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:03.747682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:03.748023 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:03.749520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:03.770636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 552/1104] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Aug 30 14:32:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:03.776908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:03.795380 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:03.890259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361ae33-7bed-4bf3-9885-113ce06b6360 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:03.935466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1abc7e-26f7-4d09-b336-5d256b064e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:03.936086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1abc7e-26f7-4d09-b336-5d256b064e15 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:03.936357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1abc7e-26f7-4d09-b336-5d256b064e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:03.936619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1abc7e-26f7-4d09-b336-5d256b064e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:04.047078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1abc7e-26f7-4d09-b336-5d256b064e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:04.049615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1abc7e-26f7-4d09-b336-5d256b064e15 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:04.067336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:04.167549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 553/1105] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:32:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:32:04.174727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:04.303001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2449e8-8908-4954-9f5c-5e0f815a4c49 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:04.340486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc913353-fe2a-4f1d-b69f-8efe1e9dc107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:04.341121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913353-fe2a-4f1d-b69f-8efe1e9dc107 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:04.341392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913353-fe2a-4f1d-b69f-8efe1e9dc107 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:04.341658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc913353-fe2a-4f1d-b69f-8efe1e9dc107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:04.353281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc913353-fe2a-4f1d-b69f-8efe1e9dc107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:04.354806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc913353-fe2a-4f1d-b69f-8efe1e9dc107 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-cc913353-fe2a-4f1d-b69f-8efe1e9dc107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:32:04.370370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:04.371725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:32:04.372611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:32:04.372611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:32:04.372611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:32:04.372611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 553/1106] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:04.382129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1abc7e-26f7-4d09-b336-5d256b064e15 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:04.408226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362ddc-e960-44a6-a7dc-f3a18434e2fb None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:04.408500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362ddc-e960-44a6-a7dc-f3a18434e2fb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:04.409151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362ddc-e960-44a6-a7dc-f3a18434e2fb None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:04.410749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 554/1107] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:04.416955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e8427-054a-47e9-a634-9473a3d01773 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:04.417452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e8427-054a-47e9-a634-9473a3d01773 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:04.417611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e8427-054a-47e9-a634-9473a3d01773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:04.439561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c13e8427-054a-47e9-a634-9473a3d01773 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:04.440791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c13e8427-054a-47e9-a634-9473a3d01773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:04.443054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:04.510998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1abc7e-26f7-4d09-b336-5d256b064e15 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:04.525589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:04.532427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 555/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:32:04.550889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:04.551513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:04.551766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:04.552039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:04.552678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:04.552969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:04.554645 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:04.566473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 554/1109] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:04.572605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e8427-054a-47e9-a634-9473a3d01773 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:04.682447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e8427-054a-47e9-a634-9473a3d01773 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:04.721289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:04.722187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:04.722187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:04.722489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:04.730094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:04.731616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:04.733568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:32:04.744579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:04.746112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:32:04.747345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 556/1110] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:04.752034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:04.856964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:04.911633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd9dc-4e11-430b-b236-14460abc5135 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:04.956181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:04.956810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:04.957079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:04.957330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:04.958032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:04.958327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:04.959858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:04.973584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 555/1111] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:04.981083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:04.996449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc963b1-cebc-49a4-b23e-2250e0fdb56d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:05.026627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:05.048723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa411dd2-963a-427a-a7da-408a6636a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:05.049792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa411dd2-963a-427a-a7da-408a6636a0bc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:05.050278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa411dd2-963a-427a-a7da-408a6636a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:05.050702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa411dd2-963a-427a-a7da-408a6636a0bc None admin] PATH_INFO: `/v3/roles/0ac8e76ee0884ae1be64093499d4865e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:05.052701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa411dd2-963a-427a-a7da-408a6636a0bc None admin] RBAC: Authorizing `identity:get_role(role_id=0ac8e76ee0884ae1be64093499d4865e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:05.055540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa411dd2-963a-427a-a7da-408a6636a0bc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:05.058248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 557/1112] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:04 2022] GET /identity/v3/roles/0ac8e76ee0884ae1be64093499d4865e => generated 223 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:32:05.067443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa411dd2-963a-427a-a7da-408a6636a0bc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:05.116916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7c5ba-7f36-4daf-9ca2-57e402468d3c None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:05.153409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:05.159306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:05.160075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:05.160343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:05.160774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:05.162772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] RBAC: Adding query filter params (role.id=479ed6989eb3488f891ace3940e62ad2, scope.project.id=fabb84470909411f80adffac902dea45, user.id=906464ed50294dc481c4d1d570a5195b) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:05.162772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:05.164660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:05.175105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 556/1113] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:32:04 2022] GET /identity/v3/role_assignments?user.id=906464ed50294dc481c4d1d570a5195b&scope.project.id=fabb84470909411f80adffac902dea45&role.id=479ed6989eb3488f891ace3940e62ad2 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:32:05.205415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa411dd2-963a-427a-a7da-408a6636a0bc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:05.248757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2e92-37ac-47f4-a828-884078245fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:05.249438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2e92-37ac-47f4-a828-884078245fae None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:05.249711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2e92-37ac-47f4-a828-884078245fae None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:05.249975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2e92-37ac-47f4-a828-884078245fae None admin] PATH_INFO: `/v3/users/d93264a792d44eb9ab4b64539ada6e03` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:05.267834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2e92-37ac-47f4-a828-884078245fae None admin] RBAC: Authorizing `identity:get_user(user_id=d93264a792d44eb9ab4b64539ada6e03)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:05.269456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2e92-37ac-47f4-a828-884078245fae None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:05.271376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 558/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:05 2022] GET /identity/v3/users/d93264a792d44eb9ab4b64539ada6e03 => generated 286 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:32:05.278006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:05.418533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:05.429388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb03a3d-da6e-40a9-aef9-7eb2c0bcefc5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:05.479705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfc457-86a7-4b40-8631-e11741dc5900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:05.480345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfc457-86a7-4b40-8631-e11741dc5900 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:05.480622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfc457-86a7-4b40-8631-e11741dc5900 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:05.480892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfc457-86a7-4b40-8631-e11741dc5900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:05.575998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfc457-86a7-4b40-8631-e11741dc5900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:05.578584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfc457-86a7-4b40-8631-e11741dc5900 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:05.690875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:05.700489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 557/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:32:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:32:05.707019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2e92-37ac-47f4-a828-884078245fae None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:05.833266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2e92-37ac-47f4-a828-884078245fae None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:05.860199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:05.873759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb09ae6-2df0-4aca-95bd-1a9a8b9da199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:05.874442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb09ae6-2df0-4aca-95bd-1a9a8b9da199 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:05.874708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb09ae6-2df0-4aca-95bd-1a9a8b9da199 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:05.874970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb09ae6-2df0-4aca-95bd-1a9a8b9da199 None admin] PATH_INFO: `/v3/projects/bc92f78f699e4d86a7923e8d3d83094b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:05.876154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb09ae6-2df0-4aca-95bd-1a9a8b9da199 None admin] RBAC: Authorizing `identity:get_project(project_id=bc92f78f699e4d86a7923e8d3d83094b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:05.877615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb09ae6-2df0-4aca-95bd-1a9a8b9da199 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:05.879322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 559/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:05 2022] GET /identity/v3/projects/bc92f78f699e4d86a7923e8d3d83094b => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:05.888327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfc457-86a7-4b40-8631-e11741dc5900 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:06.003835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfc457-86a7-4b40-8631-e11741dc5900 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:06.042146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f22fb1-85da-43cd-961f-c82b8d4c6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:06.042801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22fb1-85da-43cd-961f-c82b8d4c6b26 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:06.043076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22fb1-85da-43cd-961f-c82b8d4c6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:06.043346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f22fb1-85da-43cd-961f-c82b8d4c6b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:06.044086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f22fb1-85da-43cd-961f-c82b8d4c6b26 None admin] RBAC: Adding query filter params (role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=bc92f78f699e4d86a7923e8d3d83094b, user.id=d93264a792d44eb9ab4b64539ada6e03) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:06.044398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f22fb1-85da-43cd-961f-c82b8d4c6b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:06.045840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f22fb1-85da-43cd-961f-c82b8d4c6b26 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:06.052186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 558/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:32:05 2022] GET /identity/v3/role_assignments?user.id=d93264a792d44eb9ab4b64539ada6e03&scope.project.id=bc92f78f699e4d86a7923e8d3d83094b&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:32:08.014141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc3572-4a51-4540-a8ac-d5847f5d8b02 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:08.014776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc3572-4a51-4540-a8ac-d5847f5d8b02 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:08.014776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc3572-4a51-4540-a8ac-d5847f5d8b02 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:08.016174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 560/1118] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:08.022399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd1cd-9bc1-4b26-b585-c61c83617d57 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:08.023846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd1cd-9bc1-4b26-b585-c61c83617d57 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:08.023846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd1cd-9bc1-4b26-b585-c61c83617d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:08.042853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6c6fd1cd-9bc1-4b26-b585-c61c83617d57 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:08.044061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6c6fd1cd-9bc1-4b26-b585-c61c83617d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:08.105969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:08.119436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:08.515923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc3572-4a51-4540-a8ac-d5847f5d8b02 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:08.635990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc3572-4a51-4540-a8ac-d5847f5d8b02 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:08.674115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314728c5-38ac-4dd4-995b-8f9142012fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:08.674695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314728c5-38ac-4dd4-995b-8f9142012fdd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:08.674941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314728c5-38ac-4dd4-995b-8f9142012fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:08.675239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314728c5-38ac-4dd4-995b-8f9142012fdd None admin] PATH_INFO: `/v3/roles/0ac8e76ee0884ae1be64093499d4865e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:08.676769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314728c5-38ac-4dd4-995b-8f9142012fdd None admin] RBAC: Authorizing `identity:get_role(role_id=0ac8e76ee0884ae1be64093499d4865e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:08.678200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314728c5-38ac-4dd4-995b-8f9142012fdd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:08.679763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 561/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:08 2022] GET /identity/v3/roles/0ac8e76ee0884ae1be64093499d4865e => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:08.686034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fd1cd-9bc1-4b26-b585-c61c83617d57 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:08.793167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fd1cd-9bc1-4b26-b585-c61c83617d57 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:08.827997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38944c-723b-4701-bf3b-7cb72fe79a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:08.828753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38944c-723b-4701-bf3b-7cb72fe79a43 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:08.829132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38944c-723b-4701-bf3b-7cb72fe79a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:08.829537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38944c-723b-4701-bf3b-7cb72fe79a43 None admin] PATH_INFO: `/v3/users/d93264a792d44eb9ab4b64539ada6e03` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:08.830898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38944c-723b-4701-bf3b-7cb72fe79a43 None admin] RBAC: Authorizing `identity:get_user(user_id=d93264a792d44eb9ab4b64539ada6e03)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:08.832432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38944c-723b-4701-bf3b-7cb72fe79a43 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:08.834054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 560/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:08 2022] GET /identity/v3/users/d93264a792d44eb9ab4b64539ada6e03 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:08.840232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314728c5-38ac-4dd4-995b-8f9142012fdd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:08.904679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:08.947373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314728c5-38ac-4dd4-995b-8f9142012fdd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:08.983788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff2eda-d14e-4f8d-b417-aa6e1c361ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:08.984419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2eda-d14e-4f8d-b417-aa6e1c361ecd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:08.984690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2eda-d14e-4f8d-b417-aa6e1c361ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:08.984954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2eda-d14e-4f8d-b417-aa6e1c361ecd None admin] PATH_INFO: `/v3/projects/bc92f78f699e4d86a7923e8d3d83094b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:08.986077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff2eda-d14e-4f8d-b417-aa6e1c361ecd None admin] RBAC: Authorizing `identity:get_project(project_id=bc92f78f699e4d86a7923e8d3d83094b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:08.987560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff2eda-d14e-4f8d-b417-aa6e1c361ecd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:08.989212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 562/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:08 2022] GET /identity/v3/projects/bc92f78f699e4d86a7923e8d3d83094b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:08.995673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38944c-723b-4701-bf3b-7cb72fe79a43 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:09.055759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:09.100954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38944c-723b-4701-bf3b-7cb72fe79a43 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:09.135962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1defb-5777-4014-86f2-d633e8d39b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:09.136641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1defb-5777-4014-86f2-d633e8d39b65 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:09.136912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1defb-5777-4014-86f2-d633e8d39b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:09.137184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1defb-5777-4014-86f2-d633e8d39b65 None admin] PATH_INFO: `/v3/projects/bc92f78f699e4d86a7923e8d3d83094b/users/d93264a792d44eb9ab4b64539ada6e03/roles/0ac8e76ee0884ae1be64093499d4865e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:09.139490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1defb-5777-4014-86f2-d633e8d39b65 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc92f78f699e4d86a7923e8d3d83094b, user_id=d93264a792d44eb9ab4b64539ada6e03, role_id=0ac8e76ee0884ae1be64093499d4865e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:09.140939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1defb-5777-4014-86f2-d633e8d39b65 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:09.155797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 561/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:32:08 2022] PUT /identity/v3/projects/bc92f78f699e4d86a7923e8d3d83094b/users/d93264a792d44eb9ab4b64539ada6e03/roles/0ac8e76ee0884ae1be64093499d4865e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:32:11.067531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420c5fc-d413-4674-bb72-6909151794f9 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:11.068116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420c5fc-d413-4674-bb72-6909151794f9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:11.068116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420c5fc-d413-4674-bb72-6909151794f9 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:11.069683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 563/1124] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:11.076387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f6f9-69dd-4806-9e31-2ba8562d454e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:11.076940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f6f9-69dd-4806-9e31-2ba8562d454e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:11.076940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f6f9-69dd-4806-9e31-2ba8562d454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:11.097931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a146f6f9-69dd-4806-9e31-2ba8562d454e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:11.099383 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a146f6f9-69dd-4806-9e31-2ba8562d454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:11.176499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 562/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:11.450248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420c5fc-d413-4674-bb72-6909151794f9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:11.560535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420c5fc-d413-4674-bb72-6909151794f9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:11.589982 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:11.598581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448198-a281-41b2-8a5e-2f12f04fce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:11.599234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448198-a281-41b2-8a5e-2f12f04fce9a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:11.599511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448198-a281-41b2-8a5e-2f12f04fce9a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:11.599779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448198-a281-41b2-8a5e-2f12f04fce9a None admin] PATH_INFO: `/v3/roles/0ac8e76ee0884ae1be64093499d4865e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:11.601292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448198-a281-41b2-8a5e-2f12f04fce9a None admin] RBAC: Authorizing `identity:get_role(role_id=0ac8e76ee0884ae1be64093499d4865e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:11.602744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448198-a281-41b2-8a5e-2f12f04fce9a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:11.604135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 564/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:11 2022] GET /identity/v3/roles/0ac8e76ee0884ae1be64093499d4865e => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:11.610517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f6f9-69dd-4806-9e31-2ba8562d454e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:11.679652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:11.764500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f6f9-69dd-4806-9e31-2ba8562d454e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:11.819516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a334c-cfe0-4b9c-b26c-7fc4699b4c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:11.820283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a334c-cfe0-4b9c-b26c-7fc4699b4c25 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:11.820559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a334c-cfe0-4b9c-b26c-7fc4699b4c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:11.820837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a334c-cfe0-4b9c-b26c-7fc4699b4c25 None admin] PATH_INFO: `/v3/users/d93264a792d44eb9ab4b64539ada6e03` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:11.822044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a334c-cfe0-4b9c-b26c-7fc4699b4c25 None admin] RBAC: Authorizing `identity:get_user(user_id=d93264a792d44eb9ab4b64539ada6e03)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:11.823499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a334c-cfe0-4b9c-b26c-7fc4699b4c25 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:11.825476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 563/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:11 2022] GET /identity/v3/users/d93264a792d44eb9ab4b64539ada6e03 => generated 286 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:11.831597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448198-a281-41b2-8a5e-2f12f04fce9a None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:11.938589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448198-a281-41b2-8a5e-2f12f04fce9a None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:11.973357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a67ccd-2d4e-4d97-be5c-23f2b3536ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:11.973965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a67ccd-2d4e-4d97-be5c-23f2b3536ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:11.974235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a67ccd-2d4e-4d97-be5c-23f2b3536ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:11.974608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a67ccd-2d4e-4d97-be5c-23f2b3536ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:12.039276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:12.046875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a67ccd-2d4e-4d97-be5c-23f2b3536ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:12.048415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a67ccd-2d4e-4d97-be5c-23f2b3536ba1 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:12.174246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 565/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:32:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:32:12.180703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a334c-cfe0-4b9c-b26c-7fc4699b4c25 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:12.289778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a334c-cfe0-4b9c-b26c-7fc4699b4c25 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:12.306724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:12.325716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ab096-c421-4a32-8ebf-e3fa69c87df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:12.326354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ab096-c421-4a32-8ebf-e3fa69c87df3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:12.326664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ab096-c421-4a32-8ebf-e3fa69c87df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:12.326936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ab096-c421-4a32-8ebf-e3fa69c87df3 None admin] PATH_INFO: `/v3/projects/bc92f78f699e4d86a7923e8d3d83094b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:12.328050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ab096-c421-4a32-8ebf-e3fa69c87df3 None admin] RBAC: Authorizing `identity:get_project(project_id=bc92f78f699e4d86a7923e8d3d83094b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:12.329472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ab096-c421-4a32-8ebf-e3fa69c87df3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:12.331183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 564/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:12 2022] GET /identity/v3/projects/bc92f78f699e4d86a7923e8d3d83094b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:12.338325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a67ccd-2d4e-4d97-be5c-23f2b3536ba1 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:12.448402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:12.455322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a67ccd-2d4e-4d97-be5c-23f2b3536ba1 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:12.496167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a26d1-5a20-4fc2-bcfa-ac7d4f624f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:12.497969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a26d1-5a20-4fc2-bcfa-ac7d4f624f0e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:12.497969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a26d1-5a20-4fc2-bcfa-ac7d4f624f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:12.497969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a26d1-5a20-4fc2-bcfa-ac7d4f624f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:12.498724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a26d1-5a20-4fc2-bcfa-ac7d4f624f0e None admin] RBAC: Adding query filter params (role.id=0ac8e76ee0884ae1be64093499d4865e, scope.project.id=bc92f78f699e4d86a7923e8d3d83094b, user.id=d93264a792d44eb9ab4b64539ada6e03) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:12.499162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a26d1-5a20-4fc2-bcfa-ac7d4f624f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:12.501489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a26d1-5a20-4fc2-bcfa-ac7d4f624f0e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:12.510928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 566/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:32:12 2022] GET /identity/v3/role_assignments?user.id=d93264a792d44eb9ab4b64539ada6e03&scope.project.id=bc92f78f699e4d86a7923e8d3d83094b&role.id=0ac8e76ee0884ae1be64093499d4865e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:14.464688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a1ee-3d79-48c2-94b1-ad75c2459b00 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:14.465279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a1ee-3d79-48c2-94b1-ad75c2459b00 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:14.465279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5a1ee-3d79-48c2-94b1-ad75c2459b00 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:14.466658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 565/1131] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:14.472880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1977d7-8b4e-4095-a468-8761e5add208 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:14.473493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1977d7-8b4e-4095-a468-8761e5add208 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:14.473493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1977d7-8b4e-4095-a468-8761e5add208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:14.495566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8c1977d7-8b4e-4095-a468-8761e5add208 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:14.496811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8c1977d7-8b4e-4095-a468-8761e5add208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:14.581341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 567/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:14.848909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5a1ee-3d79-48c2-94b1-ad75c2459b00 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:14.971614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5a1ee-3d79-48c2-94b1-ad75c2459b00 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:15.008835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e90954-5c0c-40ed-9a82-f1a5fc1a12fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:15.009458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90954-5c0c-40ed-9a82-f1a5fc1a12fe None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:15.009703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90954-5c0c-40ed-9a82-f1a5fc1a12fe None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:15.009995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90954-5c0c-40ed-9a82-f1a5fc1a12fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:15.011134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90954-5c0c-40ed-9a82-f1a5fc1a12fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:15.012556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90954-5c0c-40ed-9a82-f1a5fc1a12fe None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:15.014150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 566/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:15.020475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1977d7-8b4e-4095-a468-8761e5add208 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:15.117352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:15.128541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1977d7-8b4e-4095-a468-8761e5add208 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:15.166687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feff2a-89e1-4893-bb6b-747439a98838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:15.167307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feff2a-89e1-4893-bb6b-747439a98838 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:15.167585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feff2a-89e1-4893-bb6b-747439a98838 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:15.167855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feff2a-89e1-4893-bb6b-747439a98838 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:15.168508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feff2a-89e1-4893-bb6b-747439a98838 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:15.169980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feff2a-89e1-4893-bb6b-747439a98838 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:15.201335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 568/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:32:15 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:32:17.267418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b1368-87a7-43f4-ac15-ec1d8ad10e1a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:17.268007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b1368-87a7-43f4-ac15-ec1d8ad10e1a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:17.268007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b1368-87a7-43f4-ac15-ec1d8ad10e1a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:17.269317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 567/1135] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:17.276894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d32fc-d870-480a-b09d-8e59d26ff1d7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:17.277419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d32fc-d870-480a-b09d-8e59d26ff1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:17.277636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d32fc-d870-480a-b09d-8e59d26ff1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:17.299926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-081d32fc-d870-480a-b09d-8e59d26ff1d7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:17.301208 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-081d32fc-d870-480a-b09d-8e59d26ff1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:17.393432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 569/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:17.662213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b1368-87a7-43f4-ac15-ec1d8ad10e1a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:17.729941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:17.790926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b1368-87a7-43f4-ac15-ec1d8ad10e1a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:17.829753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60cdaa-20a1-4410-ad8f-09bab77e71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:17.830429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60cdaa-20a1-4410-ad8f-09bab77e71f2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:17.830700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60cdaa-20a1-4410-ad8f-09bab77e71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:17.830952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60cdaa-20a1-4410-ad8f-09bab77e71f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:17.832119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60cdaa-20a1-4410-ad8f-09bab77e71f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:17.833571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60cdaa-20a1-4410-ad8f-09bab77e71f2 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:17.835826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 568/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:32:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:17.842144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d32fc-d870-480a-b09d-8e59d26ff1d7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:17.925838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:17.961487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d32fc-d870-480a-b09d-8e59d26ff1d7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:17.999488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6effc-995d-4ad5-941f-8c90d3b24917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:18.000105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6effc-995d-4ad5-941f-8c90d3b24917 None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:18.000382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6effc-995d-4ad5-941f-8c90d3b24917 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:18.000652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6effc-995d-4ad5-941f-8c90d3b24917 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:18.001309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6effc-995d-4ad5-941f-8c90d3b24917 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:18.002811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6effc-995d-4ad5-941f-8c90d3b24917 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:18.025632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 570/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:32:17 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:32:20.001040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f631-9742-416d-82b0-340a67ce1de1 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:20.001628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f631-9742-416d-82b0-340a67ce1de1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:20.001628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f631-9742-416d-82b0-340a67ce1de1 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:20.002964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 569/1139] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:20.008596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694fd9-46b3-4f46-97fd-87a4d33156f6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:20.009097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694fd9-46b3-4f46-97fd-87a4d33156f6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:20.009191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9694fd9-46b3-4f46-97fd-87a4d33156f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:20.030722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b9694fd9-46b3-4f46-97fd-87a4d33156f6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:20.032062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b9694fd9-46b3-4f46-97fd-87a4d33156f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:20.104998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 571/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:20.372190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f631-9742-416d-82b0-340a67ce1de1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:20.485097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f631-9742-416d-82b0-340a67ce1de1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:20.510338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:20.529692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0dea-5ec0-4419-b4f9-2a872ff37278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:20.530338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0dea-5ec0-4419-b4f9-2a872ff37278 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:20.530665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0dea-5ec0-4419-b4f9-2a872ff37278 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:20.530934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0dea-5ec0-4419-b4f9-2a872ff37278 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:20.542012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f0dea-5ec0-4419-b4f9-2a872ff37278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-cf0f0dea-5ec0-4419-b4f9-2a872ff37278 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:32:20.546839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:20.547948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:20.548834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 570/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:32:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:20.556182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9694fd9-46b3-4f46-97fd-87a4d33156f6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:20.616886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:20.661254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9694fd9-46b3-4f46-97fd-87a4d33156f6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:20.696789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:20.697408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:20.697686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:20.697957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:20.698645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:20.698944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:20.700722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:20.709573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 572/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:32:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:20.715753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0dea-5ec0-4419-b4f9-2a872ff37278 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:20.826667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0dea-5ec0-4419-b4f9-2a872ff37278 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:20.866822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bee9b6-b2da-4202-9352-f54458b914f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:20.867481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bee9b6-b2da-4202-9352-f54458b914f0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:20.867799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bee9b6-b2da-4202-9352-f54458b914f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:20.868113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bee9b6-b2da-4202-9352-f54458b914f0 None admin] PATH_INFO: `/v3/users/de461797e706412caabf306696b049d9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:20.884472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bee9b6-b2da-4202-9352-f54458b914f0 None admin] RBAC: Authorizing `identity:get_user(user_id=de461797e706412caabf306696b049d9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:20.886103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bee9b6-b2da-4202-9352-f54458b914f0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:20.887961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 571/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:20 2022] GET /identity/v3/users/de461797e706412caabf306696b049d9 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:20.894550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:21.029426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ec04c-f574-4ee4-9cf7-ab221c0da1be None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:21.052478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:21.069246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079358-d854-433c-877c-52a70fcc14a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:21.069871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079358-d854-433c-877c-52a70fcc14a2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:21.070149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079358-d854-433c-877c-52a70fcc14a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:21.070447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079358-d854-433c-877c-52a70fcc14a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:21.144918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079358-d854-433c-877c-52a70fcc14a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:21.146420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079358-d854-433c-877c-52a70fcc14a2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:21.260642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 573/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:32:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:32:21.267058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bee9b6-b2da-4202-9352-f54458b914f0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:21.314244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:21.379487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bee9b6-b2da-4202-9352-f54458b914f0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:21.416743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a023af-2195-41cf-ac8c-6f966a3a702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:21.417370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a023af-2195-41cf-ac8c-6f966a3a702f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:21.417647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a023af-2195-41cf-ac8c-6f966a3a702f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:21.417926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a023af-2195-41cf-ac8c-6f966a3a702f None admin] PATH_INFO: `/v3/projects/3f2637086b4f4dbfab8a76a98eac0941` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:21.419070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a023af-2195-41cf-ac8c-6f966a3a702f None admin] RBAC: Authorizing `identity:get_project(project_id=3f2637086b4f4dbfab8a76a98eac0941)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:21.420518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a023af-2195-41cf-ac8c-6f966a3a702f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:21.422233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 572/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:21 2022] GET /identity/v3/projects/3f2637086b4f4dbfab8a76a98eac0941 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:21.428875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079358-d854-433c-877c-52a70fcc14a2 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:21.451815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:21.534000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079358-d854-433c-877c-52a70fcc14a2 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:21.569790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75354c-c5cc-4016-ad1d-c89c5f9f40d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:21.570317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75354c-c5cc-4016-ad1d-c89c5f9f40d2 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:21.570630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75354c-c5cc-4016-ad1d-c89c5f9f40d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:21.570896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75354c-c5cc-4016-ad1d-c89c5f9f40d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:21.571626 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75354c-c5cc-4016-ad1d-c89c5f9f40d2 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=3f2637086b4f4dbfab8a76a98eac0941, user.id=de461797e706412caabf306696b049d9) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:21.571928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75354c-c5cc-4016-ad1d-c89c5f9f40d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:21.573387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75354c-c5cc-4016-ad1d-c89c5f9f40d2 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:21.579693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 574/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:32:21 2022] GET /identity/v3/role_assignments?user.id=de461797e706412caabf306696b049d9&scope.project.id=3f2637086b4f4dbfab8a76a98eac0941&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:23.483349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e362194-00b6-4567-b2eb-1d55dcb59945 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:23.483908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e362194-00b6-4567-b2eb-1d55dcb59945 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:23.483908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e362194-00b6-4567-b2eb-1d55dcb59945 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:23.485190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 573/1147] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:23.491395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3555-50d8-4eb6-a70a-d3ecb6f9eb14 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:23.492023 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3555-50d8-4eb6-a70a-d3ecb6f9eb14 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:23.492252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3555-50d8-4eb6-a70a-d3ecb6f9eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:23.513021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-375d3555-50d8-4eb6-a70a-d3ecb6f9eb14 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:23.514229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-375d3555-50d8-4eb6-a70a-d3ecb6f9eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:23.598305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 575/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:23.868470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e362194-00b6-4567-b2eb-1d55dcb59945 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:23.975573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e362194-00b6-4567-b2eb-1d55dcb59945 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:23.983141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:24.013830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d6b09-e605-48e1-9423-7f097671ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:24.014451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d6b09-e605-48e1-9423-7f097671ea18 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:24.014722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d6b09-e605-48e1-9423-7f097671ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:24.014986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d6b09-e605-48e1-9423-7f097671ea18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:24.025521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d6b09-e605-48e1-9423-7f097671ea18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-f33d6b09-e605-48e1-9423-7f097671ea18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:32:24.030276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:24.031500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:24.032334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 574/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:32:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:24.038209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d3555-50d8-4eb6-a70a-d3ecb6f9eb14 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:24.053761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:24.150895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d3555-50d8-4eb6-a70a-d3ecb6f9eb14 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:24.187681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:24.188301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:24.188576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:24.188843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:24.189502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:24.189801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:24.191231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:24.200131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 576/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:32:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:24.206443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d6b09-e605-48e1-9423-7f097671ea18 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:24.320644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d6b09-e605-48e1-9423-7f097671ea18 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:24.359245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe6bce-f0e8-460f-b0b9-e805ee9736c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:24.359896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6bce-f0e8-460f-b0b9-e805ee9736c1 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:24.360167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6bce-f0e8-460f-b0b9-e805ee9736c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:24.360435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe6bce-f0e8-460f-b0b9-e805ee9736c1 None admin] PATH_INFO: `/v3/users/de461797e706412caabf306696b049d9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:24.361596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe6bce-f0e8-460f-b0b9-e805ee9736c1 None admin] RBAC: Authorizing `identity:get_user(user_id=de461797e706412caabf306696b049d9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:24.363074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe6bce-f0e8-460f-b0b9-e805ee9736c1 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:24.364689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 575/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:24 2022] GET /identity/v3/users/de461797e706412caabf306696b049d9 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:24.371186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:24.471915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:24.495012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ce66a-1f01-4140-94ea-4e4ec788db27 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:24.530278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e91f07-6417-41f3-b3a0-4aead8622144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:24.530940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91f07-6417-41f3-b3a0-4aead8622144 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:24.531211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91f07-6417-41f3-b3a0-4aead8622144 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:24.531477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91f07-6417-41f3-b3a0-4aead8622144 None admin] PATH_INFO: `/v3/projects/3f2637086b4f4dbfab8a76a98eac0941` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:24.532615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e91f07-6417-41f3-b3a0-4aead8622144 None admin] RBAC: Authorizing `identity:get_project(project_id=3f2637086b4f4dbfab8a76a98eac0941)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:24.534068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e91f07-6417-41f3-b3a0-4aead8622144 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:24.535746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 577/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:24 2022] GET /identity/v3/projects/3f2637086b4f4dbfab8a76a98eac0941 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:24.542402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe6bce-f0e8-460f-b0b9-e805ee9736c1 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:24.578046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:24.647162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe6bce-f0e8-460f-b0b9-e805ee9736c1 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:24.681688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951030f0-4742-449a-99fe-3f3faafddcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:24.683245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951030f0-4742-449a-99fe-3f3faafddcf7 None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:24.683245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951030f0-4742-449a-99fe-3f3faafddcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:24.683245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951030f0-4742-449a-99fe-3f3faafddcf7 None admin] PATH_INFO: `/v3/projects/3f2637086b4f4dbfab8a76a98eac0941/users/de461797e706412caabf306696b049d9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:24.685472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951030f0-4742-449a-99fe-3f3faafddcf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f2637086b4f4dbfab8a76a98eac0941, user_id=de461797e706412caabf306696b049d9, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:24.686892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951030f0-4742-449a-99fe-3f3faafddcf7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:24.701126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 576/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:32:24 2022] PUT /identity/v3/projects/3f2637086b4f4dbfab8a76a98eac0941/users/de461797e706412caabf306696b049d9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:32:26.571351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6edbd-a8e0-43e6-a92f-5dabe7de3cf8 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:26.571952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6edbd-a8e0-43e6-a92f-5dabe7de3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:26.571952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6edbd-a8e0-43e6-a92f-5dabe7de3cf8 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:26.573215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 578/1154] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:26.579423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616115-d294-458d-8135-03bd9e97aba1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:26.579896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616115-d294-458d-8135-03bd9e97aba1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:26.579996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616115-d294-458d-8135-03bd9e97aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:26.600676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-db616115-d294-458d-8135-03bd9e97aba1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:26.602231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-db616115-d294-458d-8135-03bd9e97aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:26.675230 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 577/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:26.964260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6edbd-a8e0-43e6-a92f-5dabe7de3cf8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:27.082673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6edbd-a8e0-43e6-a92f-5dabe7de3cf8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:27.119241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade3fd2-d165-4df8-b462-a17ca7b9e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:27.119881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade3fd2-d165-4df8-b462-a17ca7b9e942 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:27.120162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade3fd2-d165-4df8-b462-a17ca7b9e942 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:27.120424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade3fd2-d165-4df8-b462-a17ca7b9e942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:27.139561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade3fd2-d165-4df8-b462-a17ca7b9e942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-aade3fd2-d165-4df8-b462-a17ca7b9e942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:32:27.144431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:27.145584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:32:27.146823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 579/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:32:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:27.152849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616115-d294-458d-8135-03bd9e97aba1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:27.179476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:27.258636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616115-d294-458d-8135-03bd9e97aba1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:27.293992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:27.294633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:27.294911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:27.295178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:27.295839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:27.296137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:27.297500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:27.306421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 578/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:27.313392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade3fd2-d165-4df8-b462-a17ca7b9e942 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:27.317497 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:27.423845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade3fd2-d165-4df8-b462-a17ca7b9e942 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:27.460708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd429d-b224-4230-bae8-4eb53311cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:27.461343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd429d-b224-4230-bae8-4eb53311cf15 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:27.461620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd429d-b224-4230-bae8-4eb53311cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:27.461894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd429d-b224-4230-bae8-4eb53311cf15 None admin] PATH_INFO: `/v3/users/de461797e706412caabf306696b049d9` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:27.463214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd429d-b224-4230-bae8-4eb53311cf15 None admin] RBAC: Authorizing `identity:get_user(user_id=de461797e706412caabf306696b049d9)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:27.464698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd429d-b224-4230-bae8-4eb53311cf15 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:27.466335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 580/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:27 2022] GET /identity/v3/users/de461797e706412caabf306696b049d9 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:27.472759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:27.565639 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:27.582956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4c82c-2ff1-41e2-90dd-0d409047a453 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:27.619701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf378a-abc7-4c1b-a676-ebc5bf8505e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:27.620313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf378a-abc7-4c1b-a676-ebc5bf8505e5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:27.620595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf378a-abc7-4c1b-a676-ebc5bf8505e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:27.620864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf378a-abc7-4c1b-a676-ebc5bf8505e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:27.690841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf378a-abc7-4c1b-a676-ebc5bf8505e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:27.692290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf378a-abc7-4c1b-a676-ebc5bf8505e5 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:27.778196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:27.795385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 579/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:32:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:32:27.801699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd429d-b224-4230-bae8-4eb53311cf15 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:27.876644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:27.907627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd429d-b224-4230-bae8-4eb53311cf15 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:27.948861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02443072-0d61-4d12-8437-f97e4ab6ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:27.949861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443072-0d61-4d12-8437-f97e4ab6ffae None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:27.950138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443072-0d61-4d12-8437-f97e4ab6ffae None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:27.950428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02443072-0d61-4d12-8437-f97e4ab6ffae None admin] PATH_INFO: `/v3/projects/3f2637086b4f4dbfab8a76a98eac0941` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:27.951622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02443072-0d61-4d12-8437-f97e4ab6ffae None admin] RBAC: Authorizing `identity:get_project(project_id=3f2637086b4f4dbfab8a76a98eac0941)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:27.953084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02443072-0d61-4d12-8437-f97e4ab6ffae None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:27.954809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 581/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:27 2022] GET /identity/v3/projects/3f2637086b4f4dbfab8a76a98eac0941 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:27.961574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf378a-abc7-4c1b-a676-ebc5bf8505e5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:28.068306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf378a-abc7-4c1b-a676-ebc5bf8505e5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:28.103864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374b579-2ded-4648-bc22-200895b17568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:28.104468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374b579-2ded-4648-bc22-200895b17568 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:28.105108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374b579-2ded-4648-bc22-200895b17568 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:28.105383 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374b579-2ded-4648-bc22-200895b17568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:28.106110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374b579-2ded-4648-bc22-200895b17568 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=3f2637086b4f4dbfab8a76a98eac0941, user.id=de461797e706412caabf306696b049d9) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:28.106441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374b579-2ded-4648-bc22-200895b17568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:28.107873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374b579-2ded-4648-bc22-200895b17568 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:28.113896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 580/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:32:27 2022] GET /identity/v3/role_assignments?user.id=de461797e706412caabf306696b049d9&scope.project.id=3f2637086b4f4dbfab8a76a98eac0941&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:30.051317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0c06e-b518-4b56-99b5-76bda0a2c3b2 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:30.051905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0c06e-b518-4b56-99b5-76bda0a2c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:30.051905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0c06e-b518-4b56-99b5-76bda0a2c3b2 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:30.053679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 582/1162] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:30.059502 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a806b2-61d7-4f39-a3e1-ccccda778c7d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:30.059976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a806b2-61d7-4f39-a3e1-ccccda778c7d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:30.059976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a806b2-61d7-4f39-a3e1-ccccda778c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:30.082307 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-94a806b2-61d7-4f39-a3e1-ccccda778c7d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:30.083962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-94a806b2-61d7-4f39-a3e1-ccccda778c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:30.134894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:30.170544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 581/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:30.453536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0c06e-b518-4b56-99b5-76bda0a2c3b2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:30.559250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0c06e-b518-4b56-99b5-76bda0a2c3b2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:30.594418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb53d9-042e-4f7f-8397-46cbacbfdbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:30.595024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb53d9-042e-4f7f-8397-46cbacbfdbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:30.595299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb53d9-042e-4f7f-8397-46cbacbfdbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:30.595563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb53d9-042e-4f7f-8397-46cbacbfdbc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:30.606570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:30.667015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb53d9-042e-4f7f-8397-46cbacbfdbc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:30.668378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb53d9-042e-4f7f-8397-46cbacbfdbc3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:30.768334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 583/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:32:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:32:30.774808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a806b2-61d7-4f39-a3e1-ccccda778c7d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:30.874776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a806b2-61d7-4f39-a3e1-ccccda778c7d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:30.908789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3a84c-d8a9-4240-aa64-b4c3a0d7b2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:30.909408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3a84c-d8a9-4240-aa64-b4c3a0d7b2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:30.909677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3a84c-d8a9-4240-aa64-b4c3a0d7b2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:30.909940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3a84c-d8a9-4240-aa64-b4c3a0d7b2c5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:30.918922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3a84c-d8a9-4240-aa64-b4c3a0d7b2c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:30.920363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3a84c-d8a9-4240-aa64-b4c3a0d7b2c5 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-50c3a84c-d8a9-4240-aa64-b4c3a0d7b2c5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:30.932223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:30.933803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:30.934776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 582/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:32:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:30.939887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb53d9-042e-4f7f-8397-46cbacbfdbc3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:30.991538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:31.048934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb53d9-042e-4f7f-8397-46cbacbfdbc3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:31.083201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b4c5f-ef0e-4106-ab5b-f7b5fff8cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:31.083872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b4c5f-ef0e-4106-ab5b-f7b5fff8cae9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:31.084060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b4c5f-ef0e-4106-ab5b-f7b5fff8cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:31.084379 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b4c5f-ef0e-4106-ab5b-f7b5fff8cae9 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:31.085007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b4c5f-ef0e-4106-ab5b-f7b5fff8cae9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:31.085299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b4c5f-ef0e-4106-ab5b-f7b5fff8cae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:31.086703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b4c5f-ef0e-4106-ab5b-f7b5fff8cae9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:31.093747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 584/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Aug 30 14:32:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:33.004185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a7c7-da06-472a-b6e4-7f16de5980b5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:33.004790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a7c7-da06-472a-b6e4-7f16de5980b5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:33.004790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a7c7-da06-472a-b6e4-7f16de5980b5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:33.006098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 583/1167] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:33.012194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c845d5-ec61-45f0-bb6f-4fc55b9a8f41 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:33.012657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c845d5-ec61-45f0-bb6f-4fc55b9a8f41 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:33.012773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c845d5-ec61-45f0-bb6f-4fc55b9a8f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:33.032713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a9c845d5-ec61-45f0-bb6f-4fc55b9a8f41 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:33.033905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a9c845d5-ec61-45f0-bb6f-4fc55b9a8f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:33.106787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 585/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:33.372398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a7c7-da06-472a-b6e4-7f16de5980b5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:33.419260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:33.479036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a7c7-da06-472a-b6e4-7f16de5980b5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:33.515483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab1a5-af3a-44b4-9862-488bd3e36310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:33.516100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab1a5-af3a-44b4-9862-488bd3e36310 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:33.516378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab1a5-af3a-44b4-9862-488bd3e36310 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:33.516643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab1a5-af3a-44b4-9862-488bd3e36310 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:33.517312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ab1a5-af3a-44b4-9862-488bd3e36310 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:33.518706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ab1a5-af3a-44b4-9862-488bd3e36310 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:33.536717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 584/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Tue Aug 30 14:32:33 2022] POST /identity/v3/domains => generated 267 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:32:35.484809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f514-07d4-4c32-87e1-31827c67dd8e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:35.485788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f514-07d4-4c32-87e1-31827c67dd8e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:35.485788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731f514-07d4-4c32-87e1-31827c67dd8e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:35.486732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 586/1170] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:35.493058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d05b7-0a18-4666-a0d8-9d6129f5bf4d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:35.493883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d05b7-0a18-4666-a0d8-9d6129f5bf4d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:35.493883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d05b7-0a18-4666-a0d8-9d6129f5bf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:35.516293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1c2d05b7-0a18-4666-a0d8-9d6129f5bf4d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:35.517470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1c2d05b7-0a18-4666-a0d8-9d6129f5bf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:35.586395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 585/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:32:35.850922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731f514-07d4-4c32-87e1-31827c67dd8e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:35.889036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:35.966249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731f514-07d4-4c32-87e1-31827c67dd8e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:36.022966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db131bfb-fed2-4fdb-becf-c1711dad2115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:36.023615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db131bfb-fed2-4fdb-becf-c1711dad2115 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:36.023896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db131bfb-fed2-4fdb-becf-c1711dad2115 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:36.024254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db131bfb-fed2-4fdb-becf-c1711dad2115 None admin] PATH_INFO: `/v3/domains/e1201199aba9409f848112c7e7bb6a71` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:36.037017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db131bfb-fed2-4fdb-becf-c1711dad2115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1201199aba9409f848112c7e7bb6a71)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:36.038985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db131bfb-fed2-4fdb-becf-c1711dad2115 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:36.040947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 587/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Tue Aug 30 14:32:35 2022] GET /identity/v3/domains/e1201199aba9409f848112c7e7bb6a71 => generated 267 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:36.047653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d05b7-0a18-4666-a0d8-9d6129f5bf4d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:36.080961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:36.154126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d05b7-0a18-4666-a0d8-9d6129f5bf4d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:36.188892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756c26b-2194-45df-89a4-049d1a25ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:36.189503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c26b-2194-45df-89a4-049d1a25ac66 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:36.189775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c26b-2194-45df-89a4-049d1a25ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:36.190040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c26b-2194-45df-89a4-049d1a25ac66 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:36.190718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756c26b-2194-45df-89a4-049d1a25ac66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:36.192142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756c26b-2194-45df-89a4-049d1a25ac66 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:36.220403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 586/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:32:36 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:32:38.190181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de557c3-b944-404a-8210-b25e89a3d7d5 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:38.190788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de557c3-b944-404a-8210-b25e89a3d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:38.190788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de557c3-b944-404a-8210-b25e89a3d7d5 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:38.192111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 588/1174] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:38.197536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2befd-acc4-4382-b7bd-d5993bd9492c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:38.197992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2befd-acc4-4382-b7bd-d5993bd9492c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:38.198084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2befd-acc4-4382-b7bd-d5993bd9492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:38.217536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5fe2befd-acc4-4382-b7bd-d5993bd9492c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:38.218786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5fe2befd-acc4-4382-b7bd-d5993bd9492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:38.291589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 587/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:38.571797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de557c3-b944-404a-8210-b25e89a3d7d5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:38.688909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:38.697942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de557c3-b944-404a-8210-b25e89a3d7d5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:38.734904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a725d8-decd-47ba-9428-d8b97ad1adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:38.735532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a725d8-decd-47ba-9428-d8b97ad1adde None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:38.735809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a725d8-decd-47ba-9428-d8b97ad1adde None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:38.736072 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a725d8-decd-47ba-9428-d8b97ad1adde None admin] PATH_INFO: `/v3/domains/e1201199aba9409f848112c7e7bb6a71` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:38.737224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a725d8-decd-47ba-9428-d8b97ad1adde None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1201199aba9409f848112c7e7bb6a71)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:38.738724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a725d8-decd-47ba-9428-d8b97ad1adde None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:38.740330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 589/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Tue Aug 30 14:32:38 2022] GET /identity/v3/domains/e1201199aba9409f848112c7e7bb6a71 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:38.746746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2befd-acc4-4382-b7bd-d5993bd9492c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:38.762563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:38.852663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2befd-acc4-4382-b7bd-d5993bd9492c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:38.890604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67add93c-75a4-4bc6-97e7-95b168201468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:38.891208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67add93c-75a4-4bc6-97e7-95b168201468 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:38.891468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67add93c-75a4-4bc6-97e7-95b168201468 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:38.891750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67add93c-75a4-4bc6-97e7-95b168201468 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:38.892393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67add93c-75a4-4bc6-97e7-95b168201468 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:38.893856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67add93c-75a4-4bc6-97e7-95b168201468 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:38.931274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 588/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:32:38 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:32:41.275114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756706-87eb-4a37-890c-5e573dc9401c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:41.275710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756706-87eb-4a37-890c-5e573dc9401c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:41.275710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65756706-87eb-4a37-890c-5e573dc9401c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:41.277013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 590/1178] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:41.282701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b07f-86d6-4253-93cb-ff3a81a1ec35 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:41.283156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b07f-86d6-4253-93cb-ff3a81a1ec35 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:41.283245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b07f-86d6-4253-93cb-ff3a81a1ec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:41.303376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c651b07f-86d6-4253-93cb-ff3a81a1ec35 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:41.304604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c651b07f-86d6-4253-93cb-ff3a81a1ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:41.392135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:41.400819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:41.675744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756706-87eb-4a37-890c-5e573dc9401c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:41.795199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65756706-87eb-4a37-890c-5e573dc9401c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:41.840418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b074f0e-75c4-45b1-8047-07c44521b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:41.841079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b074f0e-75c4-45b1-8047-07c44521b320 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:41.841477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b074f0e-75c4-45b1-8047-07c44521b320 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:41.841768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b074f0e-75c4-45b1-8047-07c44521b320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:41.858888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b074f0e-75c4-45b1-8047-07c44521b320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4b074f0e-75c4-45b1-8047-07c44521b320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:32:41.863732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:41.864835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:32:41.866147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 591/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:41.871585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651b07f-86d6-4253-93cb-ff3a81a1ec35 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:41.982480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651b07f-86d6-4253-93cb-ff3a81a1ec35 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:42.019267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:42.019887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:42.020156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:42.020536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:42.021146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:42.021516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:42.023135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:42.032216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 590/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:42.039550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b074f0e-75c4-45b1-8047-07c44521b320 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:42.068147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:42.156551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b074f0e-75c4-45b1-8047-07c44521b320 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:42.196441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6295d7-89d8-4e11-89c9-98901afd5f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:42.197084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6295d7-89d8-4e11-89c9-98901afd5f88 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:42.197353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6295d7-89d8-4e11-89c9-98901afd5f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:42.197615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6295d7-89d8-4e11-89c9-98901afd5f88 None admin] PATH_INFO: `/v3/users/0354a9c298b04c02945d48a597976fd0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:42.213735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6295d7-89d8-4e11-89c9-98901afd5f88 None admin] RBAC: Authorizing `identity:get_user(user_id=0354a9c298b04c02945d48a597976fd0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:42.215258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6295d7-89d8-4e11-89c9-98901afd5f88 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:42.217022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 592/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:42 2022] GET /identity/v3/users/0354a9c298b04c02945d48a597976fd0 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:42.223514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:42.308761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:42.354034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e69e01-2808-405f-9691-ff9e4eaef809 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:42.389917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e0c4-8e8b-451c-83b7-b902f486cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:42.390560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e0c4-8e8b-451c-83b7-b902f486cafd None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:42.390837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e0c4-8e8b-451c-83b7-b902f486cafd None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:42.391108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e0c4-8e8b-451c-83b7-b902f486cafd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:42.462711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9e0c4-8e8b-451c-83b7-b902f486cafd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:42.464163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9e0c4-8e8b-451c-83b7-b902f486cafd None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:42.523978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:42.567294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 591/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:32:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:32:42.574342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6295d7-89d8-4e11-89c9-98901afd5f88 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:42.658203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:42.681063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6295d7-89d8-4e11-89c9-98901afd5f88 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:42.719806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56952f41-8ed1-4c85-af52-b1d7ac0ecf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:42.720441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952f41-8ed1-4c85-af52-b1d7ac0ecf56 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:42.720716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952f41-8ed1-4c85-af52-b1d7ac0ecf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:42.720983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952f41-8ed1-4c85-af52-b1d7ac0ecf56 None admin] PATH_INFO: `/v3/projects/745c2b6e17f6429c863a356e13f653ab` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:42.722146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56952f41-8ed1-4c85-af52-b1d7ac0ecf56 None admin] RBAC: Authorizing `identity:get_project(project_id=745c2b6e17f6429c863a356e13f653ab)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:42.723652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56952f41-8ed1-4c85-af52-b1d7ac0ecf56 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:42.725307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 593/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:42 2022] GET /identity/v3/projects/745c2b6e17f6429c863a356e13f653ab => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:42.731896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e0c4-8e8b-451c-83b7-b902f486cafd None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:42.836777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e0c4-8e8b-451c-83b7-b902f486cafd None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:42.872495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a13811-4493-4d94-81d6-fc054c2ec902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:42.873107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13811-4493-4d94-81d6-fc054c2ec902 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:42.873384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13811-4493-4d94-81d6-fc054c2ec902 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:42.873654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13811-4493-4d94-81d6-fc054c2ec902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:42.874411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a13811-4493-4d94-81d6-fc054c2ec902 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=745c2b6e17f6429c863a356e13f653ab, user.id=0354a9c298b04c02945d48a597976fd0) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:42.874721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a13811-4493-4d94-81d6-fc054c2ec902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:42.876160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a13811-4493-4d94-81d6-fc054c2ec902 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:42.882156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 592/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:32:42 2022] GET /identity/v3/role_assignments?user.id=0354a9c298b04c02945d48a597976fd0&scope.project.id=745c2b6e17f6429c863a356e13f653ab&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:44.859772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fe026-ac9f-4712-a137-fc69195dbfe8 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:44.860637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fe026-ac9f-4712-a137-fc69195dbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:44.860637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fe026-ac9f-4712-a137-fc69195dbfe8 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:44.862836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 594/1186] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:44.870450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2c12-b915-4de2-b563-df6d92506d95 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:44.870887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2c12-b915-4de2-b563-df6d92506d95 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:44.870992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2c12-b915-4de2-b563-df6d92506d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:44.890723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f65f2c12-b915-4de2-b563-df6d92506d95 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:44.891926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f65f2c12-b915-4de2-b563-df6d92506d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:44.911259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:44.964364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 593/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:32:45.232291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fe026-ac9f-4712-a137-fc69195dbfe8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:45.343836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fe026-ac9f-4712-a137-fc69195dbfe8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:45.380410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccff2d-16a2-4892-b525-25c1b8022d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:45.381223 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccff2d-16a2-4892-b525-25c1b8022d1e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:45.381368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccff2d-16a2-4892-b525-25c1b8022d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:45.381624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccff2d-16a2-4892-b525-25c1b8022d1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:45.392522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccff2d-16a2-4892-b525-25c1b8022d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-31ccff2d-16a2-4892-b525-25c1b8022d1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:32:45.397413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:45.398456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:32:45.399458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 595/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:32:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:45.404857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f2c12-b915-4de2-b563-df6d92506d95 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:45.517819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f2c12-b915-4de2-b563-df6d92506d95 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:45.561616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:45.562224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:45.562528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:45.562793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:45.563448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:45.563741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:45.565081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:45.574343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 594/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:32:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:45.580347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccff2d-16a2-4892-b525-25c1b8022d1e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:45.593009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:45.689499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccff2d-16a2-4892-b525-25c1b8022d1e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:45.730088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f952-a073-4ee4-8353-f8c0ad61f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:45.730779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f952-a073-4ee4-8353-f8c0ad61f3bb None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:45.731057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f952-a073-4ee4-8353-f8c0ad61f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:45.731328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09f952-a073-4ee4-8353-f8c0ad61f3bb None admin] PATH_INFO: `/v3/users/0354a9c298b04c02945d48a597976fd0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:45.732557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09f952-a073-4ee4-8353-f8c0ad61f3bb None admin] RBAC: Authorizing `identity:get_user(user_id=0354a9c298b04c02945d48a597976fd0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:45.734080 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09f952-a073-4ee4-8353-f8c0ad61f3bb None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:45.735835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 596/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:45 2022] GET /identity/v3/users/0354a9c298b04c02945d48a597976fd0 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:45.742453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:45.763950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:45.854363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ced18-b61e-48c1-95b5-e576f93ae167 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:45.890621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367777c-e10b-4cc1-ada1-662848b0f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:45.891336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367777c-e10b-4cc1-ada1-662848b0f70e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:45.891488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367777c-e10b-4cc1-ada1-662848b0f70e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:45.891793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367777c-e10b-4cc1-ada1-662848b0f70e None admin] PATH_INFO: `/v3/projects/745c2b6e17f6429c863a356e13f653ab` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:45.892958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367777c-e10b-4cc1-ada1-662848b0f70e None admin] RBAC: Authorizing `identity:get_project(project_id=745c2b6e17f6429c863a356e13f653ab)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:45.894436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367777c-e10b-4cc1-ada1-662848b0f70e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:45.896171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 595/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:45 2022] GET /identity/v3/projects/745c2b6e17f6429c863a356e13f653ab => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:45.903195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f952-a073-4ee4-8353-f8c0ad61f3bb None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:45.984171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:46.008875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09f952-a073-4ee4-8353-f8c0ad61f3bb None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:46.045230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02783764-bb36-4845-90cf-b9f15c5f3b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:46.045889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02783764-bb36-4845-90cf-b9f15c5f3b01 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:46.046166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02783764-bb36-4845-90cf-b9f15c5f3b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:46.046434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02783764-bb36-4845-90cf-b9f15c5f3b01 None admin] PATH_INFO: `/v3/projects/745c2b6e17f6429c863a356e13f653ab/users/0354a9c298b04c02945d48a597976fd0/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:46.048444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02783764-bb36-4845-90cf-b9f15c5f3b01 None admin] RBAC: Authorizing `identity:create_grant(project_id=745c2b6e17f6429c863a356e13f653ab, user_id=0354a9c298b04c02945d48a597976fd0, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:46.049884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02783764-bb36-4845-90cf-b9f15c5f3b01 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:46.064914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 597/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:32:45 2022] PUT /identity/v3/projects/745c2b6e17f6429c863a356e13f653ab/users/0354a9c298b04c02945d48a597976fd0/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:32:47.989025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f07a00-3996-4fff-add0-cd311595dc40 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:47.989584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f07a00-3996-4fff-add0-cd311595dc40 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:47.989584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f07a00-3996-4fff-add0-cd311595dc40 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:47.991366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 596/1193] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:32:47.997758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc50e07-b899-4b3e-a4ad-70846e87afb0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:47.998217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc50e07-b899-4b3e-a4ad-70846e87afb0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:47.998306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc50e07-b899-4b3e-a4ad-70846e87afb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:48.025276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8bc50e07-b899-4b3e-a4ad-70846e87afb0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:32:48.026523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8bc50e07-b899-4b3e-a4ad-70846e87afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:32:48.101280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 598/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:32:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:32:48.407751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f07a00-3996-4fff-add0-cd311595dc40 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:48.517605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:48.543299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f07a00-3996-4fff-add0-cd311595dc40 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:48.582935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdee51-e682-48bc-9aa2-91feddcdd5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:48.583753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdee51-e682-48bc-9aa2-91feddcdd5db None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:48.584031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdee51-e682-48bc-9aa2-91feddcdd5db None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:48.584485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdee51-e682-48bc-9aa2-91feddcdd5db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:48.595627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdee51-e682-48bc-9aa2-91feddcdd5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-70cdee51-e682-48bc-9aa2-91feddcdd5db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:32:48.600955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:32:48.602621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:32:48.604282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:32:48.606582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 597/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:32:48.608491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc50e07-b899-4b3e-a4ad-70846e87afb0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:48.679365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:48.722228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc50e07-b899-4b3e-a4ad-70846e87afb0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:48.764586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:48.765275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:48.765553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:48.765820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:48.766519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:48.766823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:48.768211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:48.778246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 599/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:48.784522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdee51-e682-48bc-9aa2-91feddcdd5db None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:48.908641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdee51-e682-48bc-9aa2-91feddcdd5db None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:48.956861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54380993-35b3-4e24-8016-9b41bb595c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:48.957419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380993-35b3-4e24-8016-9b41bb595c95 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:48.957698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380993-35b3-4e24-8016-9b41bb595c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:48.957973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380993-35b3-4e24-8016-9b41bb595c95 None admin] PATH_INFO: `/v3/users/0354a9c298b04c02945d48a597976fd0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:48.959618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54380993-35b3-4e24-8016-9b41bb595c95 None admin] RBAC: Authorizing `identity:get_user(user_id=0354a9c298b04c02945d48a597976fd0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:48.961146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54380993-35b3-4e24-8016-9b41bb595c95 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:48.963945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 598/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Aug 30 14:32:48 2022] GET /identity/v3/users/0354a9c298b04c02945d48a597976fd0 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:48.970222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:49.090438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a17838-b846-4af7-b20a-f5218102528b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:49.119012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:49.128726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008ebe-2d21-432f-8ad9-e099ca4e5056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:49.129461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008ebe-2d21-432f-8ad9-e099ca4e5056 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:49.129745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008ebe-2d21-432f-8ad9-e099ca4e5056 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:49.130005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008ebe-2d21-432f-8ad9-e099ca4e5056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:49.205769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008ebe-2d21-432f-8ad9-e099ca4e5056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:49.207420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008ebe-2d21-432f-8ad9-e099ca4e5056 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:49.315731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 600/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:32:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:32:49.322125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54380993-35b3-4e24-8016-9b41bb595c95 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:49.338924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:49.428607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54380993-35b3-4e24-8016-9b41bb595c95 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:49.464082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfcf2c-2582-4414-b30d-63a1396248da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:49.464619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfcf2c-2582-4414-b30d-63a1396248da None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:49.464890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfcf2c-2582-4414-b30d-63a1396248da None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:49.465154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfcf2c-2582-4414-b30d-63a1396248da None admin] PATH_INFO: `/v3/projects/745c2b6e17f6429c863a356e13f653ab` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:49.466308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfcf2c-2582-4414-b30d-63a1396248da None admin] RBAC: Authorizing `identity:get_project(project_id=745c2b6e17f6429c863a356e13f653ab)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:49.467762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfcf2c-2582-4414-b30d-63a1396248da None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:49.469405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 599/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Aug 30 14:32:49 2022] GET /identity/v3/projects/745c2b6e17f6429c863a356e13f653ab => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:49.475776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008ebe-2d21-432f-8ad9-e099ca4e5056 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:32:49.504835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:49.578131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008ebe-2d21-432f-8ad9-e099ca4e5056 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:32:49.613390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f8a16-a08e-45bf-8db2-1a831190f1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:32:49.613992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f8a16-a08e-45bf-8db2-1a831190f1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:32:49.614266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f8a16-a08e-45bf-8db2-1a831190f1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:32:49.614565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f8a16-a08e-45bf-8db2-1a831190f1c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:32:49.615351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f8a16-a08e-45bf-8db2-1a831190f1c6 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=745c2b6e17f6429c863a356e13f653ab, user.id=0354a9c298b04c02945d48a597976fd0) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:32:49.615652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f8a16-a08e-45bf-8db2-1a831190f1c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:32:49.617101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f8a16-a08e-45bf-8db2-1a831190f1c6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:32:49.623189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 601/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:32:49 2022] GET /identity/v3/role_assignments?user.id=0354a9c298b04c02945d48a597976fd0&scope.project.id=745c2b6e17f6429c863a356e13f653ab&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:32:59.458994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=60 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:32:59.620742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=54 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:46.136931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c025ee-a060-4f0c-919d-236b2369e408 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:46.137555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c025ee-a060-4f0c-919d-236b2369e408 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:46.137555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c025ee-a060-4f0c-919d-236b2369e408 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:46.139216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 600/1201] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:33:46.145113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58a21e-cce1-4560-ab5b-1824d956b19c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:46.145777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58a21e-cce1-4560-ab5b-1824d956b19c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:46.145777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58a21e-cce1-4560-ab5b-1824d956b19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:46.166248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7c58a21e-cce1-4560-ab5b-1824d956b19c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:33:46.167627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7c58a21e-cce1-4560-ab5b-1824d956b19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:33:46.262669 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 602/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:33:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:33:46.547609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c025ee-a060-4f0c-919d-236b2369e408 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:46.689140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c025ee-a060-4f0c-919d-236b2369e408 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:46.738844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:46.739522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:46.739829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:46.740085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:46.753095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:46.754803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:33:46.772295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:46.775861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:33:46.776839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:33:46.776839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:46.776839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:33:46.776839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 601/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:33:46.779946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58a21e-cce1-4560-ab5b-1824d956b19c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:46.928379 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58a21e-cce1-4560-ab5b-1824d956b19c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:46.968620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:46.976804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce61a99-fe21-4d4e-8ec3-f1a63935db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:46.977468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce61a99-fe21-4d4e-8ec3-f1a63935db68 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:46.977749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce61a99-fe21-4d4e-8ec3-f1a63935db68 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:46.978125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce61a99-fe21-4d4e-8ec3-f1a63935db68 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:46.978803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce61a99-fe21-4d4e-8ec3-f1a63935db68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:46.979100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce61a99-fe21-4d4e-8ec3-f1a63935db68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:46.980519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce61a99-fe21-4d4e-8ec3-f1a63935db68 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:47.002434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 603/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:33:47.005811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:47.084136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:47.143553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cf4a1-5f89-4be8-8b69-702ecc8c01f8 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:47.180747 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4af77-8e0f-4f95-ae3f-90d6cee3a609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:47.181365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4af77-8e0f-4f95-ae3f-90d6cee3a609 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:47.181666 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4af77-8e0f-4f95-ae3f-90d6cee3a609 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:47.182019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4af77-8e0f-4f95-ae3f-90d6cee3a609 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:47.182891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4af77-8e0f-4f95-ae3f-90d6cee3a609 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:47.184418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4af77-8e0f-4f95-ae3f-90d6cee3a609 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:47.218856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 602/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Aug 30 14:33:47 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:33:49.331519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee895a-ad1d-49cd-9cf5-120c2cd4eacc None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:49.332204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee895a-ad1d-49cd-9cf5-120c2cd4eacc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:49.332204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee895a-ad1d-49cd-9cf5-120c2cd4eacc None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:49.333942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 604/1206] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:33:49.340975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c937dbf-fe9f-4197-8cc4-b9ebfdb31646 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:49.341647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c937dbf-fe9f-4197-8cc4-b9ebfdb31646 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:49.341647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c937dbf-fe9f-4197-8cc4-b9ebfdb31646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:49.363804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2c937dbf-fe9f-4197-8cc4-b9ebfdb31646 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:33:49.365455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2c937dbf-fe9f-4197-8cc4-b9ebfdb31646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:33:49.454916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 603/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:33:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:33:49.722090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee895a-ad1d-49cd-9cf5-120c2cd4eacc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:49.866614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee895a-ad1d-49cd-9cf5-120c2cd4eacc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:49.913231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead2e0b-1302-4ab8-9626-660a4422279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:49.913939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead2e0b-1302-4ab8-9626-660a4422279d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:49.914978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead2e0b-1302-4ab8-9626-660a4422279d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:49.915422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead2e0b-1302-4ab8-9626-660a4422279d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:49.930664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead2e0b-1302-4ab8-9626-660a4422279d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-2ead2e0b-1302-4ab8-9626-660a4422279d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:33:49.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:49.937542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:33:49.939436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 605/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:33:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:49.943944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c937dbf-fe9f-4197-8cc4-b9ebfdb31646 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:49.987896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:50.061057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c937dbf-fe9f-4197-8cc4-b9ebfdb31646 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:50.110873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:50.111533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:50.111854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:50.112069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:50.112840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:50.113351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:50.115497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:50.126192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 604/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:33:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:50.132357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead2e0b-1302-4ab8-9626-660a4422279d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:50.207457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:50.293478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead2e0b-1302-4ab8-9626-660a4422279d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:50.341528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:50.342367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:50.342808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:50.343199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:50.357747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:50.359593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:33:50.381161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:50.382718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:33:50.383638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:33:50.383638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:50.383638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:33:50.383638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 606/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:50.389845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:50.554762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:50.560560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3a25-6b2c-4020-ac61-726fb1262a45 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:50.609900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:50.611001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:50.611495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:50.611985 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:50.612673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:50.613000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:50.614512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:50.628797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 605/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:50.637491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:50.762935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3077c2d-640a-4907-b99b-bba41c5d0ed3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:50.765049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:50.817136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:50.818163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:50.818819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:50.819545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:50.830891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:50.833005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:33:50.846408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:50.847935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:33:50.849460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:33:50.853539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 607/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:33:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:50.854626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:51.014491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e075ced-df2d-40a6-bb1e-854d15e287c0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:51.078114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:51.079156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:51.079443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:51.079942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:51.080804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:51.081136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:51.083971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:51.120227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 606/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Aug 30 14:33:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:51.129052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:51.276815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d796a-4e12-4924-bf5c-e908e3823525 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:51.328936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced4ab-3dfd-44ed-8d6a-04d8f6effc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:51.329441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced4ab-3dfd-44ed-8d6a-04d8f6effc86 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:51.329998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced4ab-3dfd-44ed-8d6a-04d8f6effc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:51.330603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced4ab-3dfd-44ed-8d6a-04d8f6effc86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:51.401900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:51.459278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dced4ab-3dfd-44ed-8d6a-04d8f6effc86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:51.462035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dced4ab-3dfd-44ed-8d6a-04d8f6effc86 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:51.616652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 608/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:33:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:33:51.623716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:51.652830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:51.762779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1b9bf-73a2-44aa-95c2-48a160390b41 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:51.809656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:51.810306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:51.810611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:51.810893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:51.826541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:51.828059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:33:51.844398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:51.846218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:33:51.847930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:33:51.847930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:51.847930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:33:51.847930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 607/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:51.852373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced4ab-3dfd-44ed-8d6a-04d8f6effc86 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:51.943100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:51.997745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced4ab-3dfd-44ed-8d6a-04d8f6effc86 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:52.041995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:52.043108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:52.043673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:52.044237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:52.045270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:52.045866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:52.048131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:52.071596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 609/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:33:52.073273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:52.163134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:52.212142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33a109-16be-4686-a52c-76dce57b702d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:52.252674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:52.253391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:52.253718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:52.253992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:52.263056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:52.264796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:33:52.277456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:52.278638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:52.279745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:33:52.279745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:33:52.279745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:33:52.279745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:33:52.279745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:33:52.279745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:33:52.279745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:33:52.279745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:33:52.281634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 608/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:52.288542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:52.437136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae5ae7-627f-42ec-a70c-c891f76f668d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:52.464476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:52.482070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c2418-b140-4555-b3f7-c8a050900c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:52.482789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c2418-b140-4555-b3f7-c8a050900c3e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:52.483109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c2418-b140-4555-b3f7-c8a050900c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:52.483411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c2418-b140-4555-b3f7-c8a050900c3e None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:52.484155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c2418-b140-4555-b3f7-c8a050900c3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:52.484500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c2418-b140-4555-b3f7-c8a050900c3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:52.486259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c2418-b140-4555-b3f7-c8a050900c3e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:52.507679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 610/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:52.509129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:52.644872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd2778-cf59-4ecb-81ca-5d7fcac04b4f None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:52.679123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:52.685255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b7f57-18f9-4f45-9277-0e7b74df1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:52.685869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b7f57-18f9-4f45-9277-0e7b74df1e11 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:52.686152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b7f57-18f9-4f45-9277-0e7b74df1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:52.686440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b7f57-18f9-4f45-9277-0e7b74df1e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:52.687172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b7f57-18f9-4f45-9277-0e7b74df1e11 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=64e595269cd746d68edd59783c1d6314) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:52.687500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b7f57-18f9-4f45-9277-0e7b74df1e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:52.688944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b7f57-18f9-4f45-9277-0e7b74df1e11 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:52.695210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 609/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:33:52 2022] GET /identity/v3/role_assignments?user.id=64e595269cd746d68edd59783c1d6314&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:54.730790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0896e70-bd8e-45ab-870f-3f8200296174 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:54.731319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0896e70-bd8e-45ab-870f-3f8200296174 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:54.731319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0896e70-bd8e-45ab-870f-3f8200296174 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:54.732753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 611/1220] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:33:54.738726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097298-f8cd-4f23-b196-80cbf17bdad9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:54.739194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097298-f8cd-4f23-b196-80cbf17bdad9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:54.739286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca097298-f8cd-4f23-b196-80cbf17bdad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:54.758436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ca097298-f8cd-4f23-b196-80cbf17bdad9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:33:54.759779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ca097298-f8cd-4f23-b196-80cbf17bdad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:33:54.834573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 610/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:33:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:33:55.111136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0896e70-bd8e-45ab-870f-3f8200296174 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:55.231247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0896e70-bd8e-45ab-870f-3f8200296174 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:55.271782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74cec5-261e-4866-96d9-d8f9c3d6caf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:55.272414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74cec5-261e-4866-96d9-d8f9c3d6caf3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:55.272723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74cec5-261e-4866-96d9-d8f9c3d6caf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:55.273033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74cec5-261e-4866-96d9-d8f9c3d6caf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:55.286212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74cec5-261e-4866-96d9-d8f9c3d6caf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-3a74cec5-261e-4866-96d9-d8f9c3d6caf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:33:55.292498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:55.294641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:33:55.296660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:33:55.298573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 612/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:33:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:33:55.304922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca097298-f8cd-4f23-b196-80cbf17bdad9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:55.417750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca097298-f8cd-4f23-b196-80cbf17bdad9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:55.443487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:55.456133 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:55.456955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:55.457258 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:55.457582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:55.458303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] RBAC: Adding query filter params (name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:55.458628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:55.460157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:55.469042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 611/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:33:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:55.475264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74cec5-261e-4866-96d9-d8f9c3d6caf3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:55.525342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:55.590426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74cec5-261e-4866-96d9-d8f9c3d6caf3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:55.629134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:55.630573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:55.630893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:55.631171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:55.644160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:55.646422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:33:55.663187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:55.664377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:33:55.665270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:33:55.665270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:55.665270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:33:55.665270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 613/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:55.670874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:55.800669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56d19e-02a0-4c2d-a2b8-d4f9bbc2f992 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:55.837473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:55.838110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:55.838439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:55.838714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:55.839484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:55.839735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:55.841182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:55.858850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 612/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:55.860371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:55.962624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:55.969942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cde3db-92ab-46e4-9830-eac493168dad None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:56.008496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:56.009138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:56.009451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:56.009762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:56.017993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:56.019633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:33:56.035185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:56.036400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:33:56.037396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 614/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:33:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:56.043524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:56.095726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:56.152991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a16da-9656-4535-a080-e56b732ddb22 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:56.189336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:56.189932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:56.190210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:56.190508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:56.191245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:56.191551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:56.193165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:56.214595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 613/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Aug 30 14:33:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:56.220614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:56.333271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb79f9-dfec-4d16-acf4-e51d99a56f6f None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:56.372074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:56.372719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:56.372994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:56.373258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:56.388627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:56.390132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:33:56.405226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:56.406514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:33:56.407601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:33:56.407601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:33:56.407601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:33:56.407601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 615/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:56.414991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:56.542861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8777-7214-4d9e-ae9a-836737141468 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:56.546198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:56.583064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:56.583838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:56.584399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:56.584694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:56.585289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:56.585861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:56.587846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:56.602543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 614/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:56.608663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:56.619316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:56.721855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f745ebe-d9a2-4b12-8998-c3cdbd225db3 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:56.761874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:56.762704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:56.762930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:56.763237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:56.772692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:56.774527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:33:56.790171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:56.796615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:33:56.797721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 616/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:56.798410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:56.922816 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4aca2-8f5b-4a06-a432-7b00f139e706 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:56.963778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235936c8-50ef-4a89-bc54-46fcfea5fa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:56.964409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235936c8-50ef-4a89-bc54-46fcfea5fa66 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:56.964684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235936c8-50ef-4a89-bc54-46fcfea5fa66 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:56.964984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235936c8-50ef-4a89-bc54-46fcfea5fa66 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:56.965640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235936c8-50ef-4a89-bc54-46fcfea5fa66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:56.965942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235936c8-50ef-4a89-bc54-46fcfea5fa66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:56.967417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235936c8-50ef-4a89-bc54-46fcfea5fa66 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:56.981631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 615/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:56.988856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:57.065284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:57.102713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea36ab-b67f-43c2-a1c4-e53b739f7916 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:57.141855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c0bbf-118a-4c98-adc3-d6370ad39a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:57.142652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0bbf-118a-4c98-adc3-d6370ad39a41 None admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:57.142948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0bbf-118a-4c98-adc3-d6370ad39a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:57.143229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c0bbf-118a-4c98-adc3-d6370ad39a41 None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/64e595269cd746d68edd59783c1d6314/roles/b02fcaf15370497abe5973b37a3a2a74` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:57.160951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0bbf-118a-4c98-adc3-d6370ad39a41 None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=64e595269cd746d68edd59783c1d6314, role_id=b02fcaf15370497abe5973b37a3a2a74)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:57.162577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c0bbf-118a-4c98-adc3-d6370ad39a41 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:57.177311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 617/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:33:56 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/64e595269cd746d68edd59783c1d6314/roles/b02fcaf15370497abe5973b37a3a2a74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:33:59.130842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901824c-876f-4b27-a1a1-359d22ed74e7 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:59.131519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901824c-876f-4b27-a1a1-359d22ed74e7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:59.131519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901824c-876f-4b27-a1a1-359d22ed74e7 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:59.132942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 616/1233] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:33:59.138667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76803d9-7189-43d7-902d-04100ff6e51a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:59.139154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76803d9-7189-43d7-902d-04100ff6e51a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:59.139282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76803d9-7189-43d7-902d-04100ff6e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:59.157510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f76803d9-7189-43d7-902d-04100ff6e51a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:33:59.158767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f76803d9-7189-43d7-902d-04100ff6e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:33:59.230200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 618/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:33:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:33:59.495160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901824c-876f-4b27-a1a1-359d22ed74e7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:59.526292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:59.613731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901824c-876f-4b27-a1a1-359d22ed74e7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:59.650934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708281-d387-46db-a987-f199740d9bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:59.651574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708281-d387-46db-a987-f199740d9bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:59.651850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708281-d387-46db-a987-f199740d9bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:59.652120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708281-d387-46db-a987-f199740d9bc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:59.663118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d708281-d387-46db-a987-f199740d9bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-1d708281-d387-46db-a987-f199740d9bc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:33:59.668648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:33:59.669822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:33:59.670865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 617/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Aug 30 14:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:33:59.677560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76803d9-7189-43d7-902d-04100ff6e51a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:59.733388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:59.793409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76803d9-7189-43d7-902d-04100ff6e51a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:59.829067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:59.829691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:59.829967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:33:59.830235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:33:59.830934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:33:59.831300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:33:59.832746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:33:59.841897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 619/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Aug 30 14:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:33:59.848124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708281-d387-46db-a987-f199740d9bc2 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:33:59.940612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:33:59.958575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708281-d387-46db-a987-f199740d9bc2 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:33:59.998948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:33:59.999593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:33:59.999927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:00.000210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:00.011371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:00.012836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:34:00.030204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:00.031962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:34:00.033246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:34:00.033246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:00.033246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:00.033246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 618/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:34:00.038714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:00.162775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8908e-aa9e-49a8-864a-46d5e954f6fd None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:00.172377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:00.200234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:00.200796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:00.201104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:00.201409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:00.202114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:00.202463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:00.203955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:00.218517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 620/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:00.224785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:00.350658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc0966-07bd-46b6-b303-ca146f051c14 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:00.392320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:00.393080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:00.393363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:00.393670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:00.397303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:00.403312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:00.404880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:34:00.417616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:00.418656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:00.419623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 619/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:34:00.425133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:00.537635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732c9a4-efa9-4ec3-be60-96da9b2ddaff None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:00.576827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:00.577454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:00.577736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:00.578009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:00.578782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:00.579092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:00.580742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:00.603681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 621/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Aug 30 14:34:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:34:00.610424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:00.727005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1f7a3-c552-4534-ac46-fa28cd555d10 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:00.771873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558025e0-f2f2-4733-bc0f-8a7e8fc3074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:00.772692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558025e0-f2f2-4733-bc0f-8a7e8fc3074e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:00.772991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558025e0-f2f2-4733-bc0f-8a7e8fc3074e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:00.773243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558025e0-f2f2-4733-bc0f-8a7e8fc3074e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:00.843728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:00.851896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558025e0-f2f2-4733-bc0f-8a7e8fc3074e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:00.853670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558025e0-f2f2-4733-bc0f-8a7e8fc3074e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:00.972389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 620/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:34:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 14:34:00.979502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:01.010630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:01.094363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792d95-2d63-47e9-b2d2-ccdddecb7fcc None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:01.132375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:01.133044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:01.133319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:01.133659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:01.147481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:01.148996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:34:01.164842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:01.166307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:34:01.167246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:34:01.167246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:01.167246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:01.167246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 622/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:34:01.172342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558025e0-f2f2-4733-bc0f-8a7e8fc3074e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:01.279065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:01.286097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558025e0-f2f2-4733-bc0f-8a7e8fc3074e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:01.335005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:01.335583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:01.335858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:01.336110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:01.336806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:01.337091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:01.338556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:01.358425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 621/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:34:01.359677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:01.451623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:01.478750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f11ecb-eb08-4d40-b3c5-5a2a025f6800 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:01.516301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:01.516943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:01.517250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:01.517515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:01.525172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:01.528271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:34:01.541996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:01.549048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:01.550286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 623/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:01.551006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:01.667285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab2a33-7e87-4588-aa5f-ff36a1ab34d5 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:01.707787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9811-8a51-40cb-ad05-af1c3ebb3cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:01.708561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9811-8a51-40cb-ad05-af1c3ebb3cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:01.708843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9811-8a51-40cb-ad05-af1c3ebb3cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:01.709111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9811-8a51-40cb-ad05-af1c3ebb3cb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:01.709829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9811-8a51-40cb-ad05-af1c3ebb3cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:01.710137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9811-8a51-40cb-ad05-af1c3ebb3cb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:01.711824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9811-8a51-40cb-ad05-af1c3ebb3cb3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:01.727410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 622/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:01.734244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:01.853930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d50da-48db-4fa8-a3c8-db5a2f2d8c0d None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:01.896174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175021e3-ef9f-46a8-ae69-4136b4572c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:01.896772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175021e3-ef9f-46a8-ae69-4136b4572c75 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:01.897048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175021e3-ef9f-46a8-ae69-4136b4572c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:01.897319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175021e3-ef9f-46a8-ae69-4136b4572c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:01.898282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175021e3-ef9f-46a8-ae69-4136b4572c75 None admin] RBAC: Adding query filter params (role.id=b02fcaf15370497abe5973b37a3a2a74, scope.project.id=fabb84470909411f80adffac902dea45, user.id=64e595269cd746d68edd59783c1d6314) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:01.898875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175021e3-ef9f-46a8-ae69-4136b4572c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:01.901491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175021e3-ef9f-46a8-ae69-4136b4572c75 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:01.908669 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 624/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:34:01 2022] GET /identity/v3/role_assignments?user.id=64e595269cd746d68edd59783c1d6314&scope.project.id=fabb84470909411f80adffac902dea45&role.id=b02fcaf15370497abe5973b37a3a2a74 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:03.891612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a9bd7-47bf-4047-90f6-4db7f69da023 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:03.892278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a9bd7-47bf-4047-90f6-4db7f69da023 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:03.892278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a9bd7-47bf-4047-90f6-4db7f69da023 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:03.893502 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 623/1247] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:34:03.899261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f298320-a5e4-4066-b7ba-6ca2a57f6ce0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:03.899790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f298320-a5e4-4066-b7ba-6ca2a57f6ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:03.899790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f298320-a5e4-4066-b7ba-6ca2a57f6ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:03.906328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:03.919141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3f298320-a5e4-4066-b7ba-6ca2a57f6ce0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:34:03.920342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3f298320-a5e4-4066-b7ba-6ca2a57f6ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:34:03.991256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 625/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:34:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:34:04.293025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a9bd7-47bf-4047-90f6-4db7f69da023 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:04.314608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:04.434773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a9bd7-47bf-4047-90f6-4db7f69da023 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:04.479297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818b35b-410f-4be0-994d-60f471ff26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:04.480001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818b35b-410f-4be0-994d-60f471ff26f6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:04.480291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818b35b-410f-4be0-994d-60f471ff26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:04.480558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818b35b-410f-4be0-994d-60f471ff26f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:04.491647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818b35b-410f-4be0-994d-60f471ff26f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-3818b35b-410f-4be0-994d-60f471ff26f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:34:04.496740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:04.498428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:04.500697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 624/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:04.509060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f298320-a5e4-4066-b7ba-6ca2a57f6ce0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:04.633891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f298320-a5e4-4066-b7ba-6ca2a57f6ce0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:04.673070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:04.678803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:04.679723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:04.680016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:04.680503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:04.681628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:04.682106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:04.683926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:04.696261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 626/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:34:04.702938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818b35b-410f-4be0-994d-60f471ff26f6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:04.803854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:04.836290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818b35b-410f-4be0-994d-60f471ff26f6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:04.880663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:04.881305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:04.881576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:04.881837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:04.896046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:04.896046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:34:04.913381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:04.914594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:34:04.915519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:34:04.915519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:04.915519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:04.915519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 625/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:04.923562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:05.078492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40c048-18df-4a72-8b0a-3d0406eedb32 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:05.129533 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:05.130274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:05.130687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:05.131039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:05.132003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:05.132387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:05.134294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:05.154817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 627/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:05.163645 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:05.302813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bc83-7c69-4765-8504-2a527f5d919d None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:05.354803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:05.373582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:05.374319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:05.374685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:05.375053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:05.386407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:05.387717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:34:05.400889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:05.402162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:05.403334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 626/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:34:05.409042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:05.485481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:05.544843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f36385-4ca7-4320-86c1-6cb7317c858b None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:05.588899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:05.589973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:05.590499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:05.591031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:05.592310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:05.592813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:05.595355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:05.619843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 628/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Aug 30 14:34:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:05.626593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:05.763781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c7f0-3688-41d5-be1a-dbd4bb9f73c9 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:05.809885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8a197-90c3-41e0-8cf0-1239e9a1beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:05.811619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8a197-90c3-41e0-8cf0-1239e9a1beb3 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:05.811619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8a197-90c3-41e0-8cf0-1239e9a1beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:05.811935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8a197-90c3-41e0-8cf0-1239e9a1beb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:05.915093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:05.932600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8a197-90c3-41e0-8cf0-1239e9a1beb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:05.934440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8a197-90c3-41e0-8cf0-1239e9a1beb3 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:06.069349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 627/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:34:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:34:06.077417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:06.255309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d1159-4369-4348-9aa5-552e22a269ff None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:06.274046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:06.302465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:06.303590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:06.304042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:06.304503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:06.322485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:06.324741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:34:06.349018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:06.352128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:34:06.353813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:34:06.353813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:06.353813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:06.353813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 629/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:06.358443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8a197-90c3-41e0-8cf0-1239e9a1beb3 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:06.505003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:06.524303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8a197-90c3-41e0-8cf0-1239e9a1beb3 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:06.576649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:06.577258 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:06.577750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:06.578097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:06.579127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:06.579612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:06.581310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:06.598183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 628/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:06.605110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:06.771324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ef0d-39a7-4c17-a435-91ea33e9f257 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:06.830130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:06.831066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:06.831461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:06.832720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:06.846676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:06.849049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:34:06.864129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:06.866219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:06.868343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 630/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:06.874369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:07.027609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a6ed-5543-412f-822a-b0267119a586 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:07.079614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b54bcc-d5ec-434f-ad21-1cb5a929dba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:07.080748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b54bcc-d5ec-434f-ad21-1cb5a929dba6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:07.080959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b54bcc-d5ec-434f-ad21-1cb5a929dba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:07.081187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b54bcc-d5ec-434f-ad21-1cb5a929dba6 None admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:07.082858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b54bcc-d5ec-434f-ad21-1cb5a929dba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:07.083171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b54bcc-d5ec-434f-ad21-1cb5a929dba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:07.084652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b54bcc-d5ec-434f-ad21-1cb5a929dba6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:07.100363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 629/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:07.107853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:07.139965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:07.293697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd6788-7a3a-429a-ac5b-c07865cce460 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:07.344137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491059f8-93c6-465a-a5b1-56d58299566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:07.344852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491059f8-93c6-465a-a5b1-56d58299566a None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:07.345281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491059f8-93c6-465a-a5b1-56d58299566a None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:07.345697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491059f8-93c6-465a-a5b1-56d58299566a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:07.347022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491059f8-93c6-465a-a5b1-56d58299566a None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=fabb84470909411f80adffac902dea45, user.id=64e595269cd746d68edd59783c1d6314) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:07.347657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491059f8-93c6-465a-a5b1-56d58299566a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:07.349835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491059f8-93c6-465a-a5b1-56d58299566a None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:07.374433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 631/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:34:07 2022] GET /identity/v3/role_assignments?user.id=64e595269cd746d68edd59783c1d6314&scope.project.id=fabb84470909411f80adffac902dea45&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:09.609156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ec84-3d48-4684-a4ac-379058a877cc None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:09.609744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ec84-3d48-4684-a4ac-379058a877cc None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:09.609744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ec84-3d48-4684-a4ac-379058a877cc None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:09.611099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 630/1261] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:34:09.617596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545113c-fd14-4f7c-a448-5accc9ba400e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:09.618190 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545113c-fd14-4f7c-a448-5accc9ba400e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:09.618190 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545113c-fd14-4f7c-a448-5accc9ba400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:09.638698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8545113c-fd14-4f7c-a448-5accc9ba400e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:34:09.639955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8545113c-fd14-4f7c-a448-5accc9ba400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:34:09.722838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 632/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:34:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:34:10.001230 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442ec84-3d48-4684-a4ac-379058a877cc None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:10.016898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:10.147979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442ec84-3d48-4684-a4ac-379058a877cc None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:10.185100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03443-15df-4341-9c10-3d68644f7291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:10.185756 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03443-15df-4341-9c10-3d68644f7291 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:10.186085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03443-15df-4341-9c10-3d68644f7291 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:10.186423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03443-15df-4341-9c10-3d68644f7291 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:10.199101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c03443-15df-4341-9c10-3d68644f7291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-73c03443-15df-4341-9c10-3d68644f7291 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:34:10.204459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:10.205762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:10.207669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 631/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:10.215451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545113c-fd14-4f7c-a448-5accc9ba400e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:10.239706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:10.352051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545113c-fd14-4f7c-a448-5accc9ba400e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:10.395740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:10.396433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:10.396759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:10.397090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:10.397868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:10.398296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:10.400001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:10.409206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 633/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:10.417494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03443-15df-4341-9c10-3d68644f7291 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:10.491499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:10.532070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03443-15df-4341-9c10-3d68644f7291 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:10.572159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:10.572922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:10.573237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:10.573546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:10.585721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:10.587327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:34:10.604501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:10.606014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:34:10.607888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:34:10.607888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:10.607888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:10.607888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 632/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:10.613466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:10.733652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:10.757647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f877c0a-9e96-470d-805e-a22df72ee2e6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:10.797132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:10.797765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:10.798041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:10.798345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:10.799021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:10.799350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:10.800951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:10.814963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 634/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:10.822633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:10.936565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0cfb6-6d9a-4811-a603-9f541bcb1ab0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:10.959981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:10.975536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:10.976292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:10.976606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:10.976933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:10.985324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:10.986831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:34:10.999768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:11.001098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:11.003126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 633/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:11.008548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:11.122990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fcffb-0c35-414b-b2cd-5b3a33eb310e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:11.160527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:11.161142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:11.161415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:11.161689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:11.162459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:11.162768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:11.164226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:11.174490 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:11.185673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 635/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Aug 30 14:34:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:34:11.191722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:11.312687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc06cc-eb63-4a48-8cde-cb19af704d49 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:11.368216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:11.369039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:11.369480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:11.370072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:11.386806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:11.388592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:34:11.406895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:11.408441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:34:11.410086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:34:11.410086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:11.410086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:11.410086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 634/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:11.417106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:11.527561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b7d47-109d-4b59-998a-aefeb9f29b07 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:11.564881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:11.565500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:11.565829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:11.566076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:11.566786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:11.567180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:11.568589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:11.582652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 636/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:11.589236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:11.630109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:11.718217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ce86-1031-4e3d-9cc0-25e1c84951ec None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:11.766032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:11.766870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:11.767205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:11.767583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:11.778183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:11.780088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:34:11.795162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:11.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:11.797436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 635/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:11.806121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:11.886652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:11.933529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1550543-719e-4010-bf9c-9d44a9e61f8e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:11.972918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb472f-5b7d-44cf-8895-eb9f153a9417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:11.973470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb472f-5b7d-44cf-8895-eb9f153a9417 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:11.973747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb472f-5b7d-44cf-8895-eb9f153a9417 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:11.974014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb472f-5b7d-44cf-8895-eb9f153a9417 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:11.974828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb472f-5b7d-44cf-8895-eb9f153a9417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:11.975127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb472f-5b7d-44cf-8895-eb9f153a9417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:11.976595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb472f-5b7d-44cf-8895-eb9f153a9417 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:11.990139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 637/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:11.997502 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:12.128828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:12.143714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb13d2-d920-42f1-8a65-3ac28b3df597 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:12.192675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ac214-0656-45de-9ebe-0f75f6560f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:12.193357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac214-0656-45de-9ebe-0f75f6560f7e None admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:12.193628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac214-0656-45de-9ebe-0f75f6560f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:12.193894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac214-0656-45de-9ebe-0f75f6560f7e None admin] PATH_INFO: `/v3/projects/fabb84470909411f80adffac902dea45/users/64e595269cd746d68edd59783c1d6314/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:12.195920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ac214-0656-45de-9ebe-0f75f6560f7e None admin] RBAC: Authorizing `identity:create_grant(project_id=fabb84470909411f80adffac902dea45, user_id=64e595269cd746d68edd59783c1d6314, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:12.197811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ac214-0656-45de-9ebe-0f75f6560f7e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:12.213133 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 636/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Aug 30 14:34:11 2022] PUT /identity/v3/projects/fabb84470909411f80adffac902dea45/users/64e595269cd746d68edd59783c1d6314/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:34:14.251215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012913-6a3e-4f38-8491-77064d2f2df7 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:14.252077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012913-6a3e-4f38-8491-77064d2f2df7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:14.252077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86012913-6a3e-4f38-8491-77064d2f2df7 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:14.253695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 638/1274] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:34:14.259745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8879-a26c-4036-b890-99fb6c04fbc7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:14.260245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8879-a26c-4036-b890-99fb6c04fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:14.260352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a8879-a26c-4036-b890-99fb6c04fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:14.279632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2e5a8879-a26c-4036-b890-99fb6c04fbc7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:34:14.280833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2e5a8879-a26c-4036-b890-99fb6c04fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:34:14.367674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 637/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:34:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:34:14.664087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86012913-6a3e-4f38-8491-77064d2f2df7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:14.781250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86012913-6a3e-4f38-8491-77064d2f2df7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:14.803519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:14.826979 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277bc32-53fd-4c2c-90d5-ebf22f726e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:14.827915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277bc32-53fd-4c2c-90d5-ebf22f726e4e None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:14.828181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277bc32-53fd-4c2c-90d5-ebf22f726e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:14.828596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277bc32-53fd-4c2c-90d5-ebf22f726e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:14.842566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277bc32-53fd-4c2c-90d5-ebf22f726e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-7277bc32-53fd-4c2c-90d5-ebf22f726e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 14:34:14.849009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:14.850203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:14.851441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 639/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Aug 30 14:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:14.857524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a8879-a26c-4036-b890-99fb6c04fbc7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:14.964439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:14.985643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a8879-a26c-4036-b890-99fb6c04fbc7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:15.022969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:15.023600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:15.023877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:15.024148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:15.024850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:15.025152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:15.026611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:15.037061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 638/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Aug 30 14:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:15.044141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277bc32-53fd-4c2c-90d5-ebf22f726e4e None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:15.159907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277bc32-53fd-4c2c-90d5-ebf22f726e4e None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:15.197191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:15.197829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:15.198102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:15.198365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:15.210142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:15.211665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:34:15.227798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:15.228997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:34:15.230057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:34:15.230057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:15.230057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:15.230678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 640/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:15.235108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:15.368233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b04f5d-34c5-49ed-8407-06070afff54e None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:15.404215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:15.404845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:15.405119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:15.405388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:15.406039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:15.406339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:15.407776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:15.421257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 639/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:15.427738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:15.465249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:15.570565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a7eea-fbd1-4b86-becc-552862fc8901 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:15.619524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:15.620565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:15.621034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:15.621486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:15.631739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:15.633210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 14:34:15.645808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:15.647541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:15.648608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 641/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:15.653201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:15.657259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:15.773788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee21d4c-2348-4b27-b733-8c3449369094 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:15.811089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:15.811712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:15.811988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:15.812258 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:15.812996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:15.813296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:15.814776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:15.834634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 640/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Aug 30 14:34:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:15.843064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:15.954838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:15.968786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da687d4-27a4-43b9-8d50-dc00d3a9fe88 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:16.010510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131393-2174-4ac8-9fee-5da70c1d94f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:16.011533 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131393-2174-4ac8-9fee-5da70c1d94f6 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:16.011808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131393-2174-4ac8-9fee-5da70c1d94f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:16.012073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131393-2174-4ac8-9fee-5da70c1d94f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:16.111656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131393-2174-4ac8-9fee-5da70c1d94f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:16.119876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131393-2174-4ac8-9fee-5da70c1d94f6 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:16.229149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:16.242663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 642/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Aug 30 14:34:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 14:34:16.250062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:16.349874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:16.395052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd708b0-befd-4a3b-a575-42bb26e89dd6 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:16.431847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:16.432493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:16.432772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:16.433041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:16.444184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:16.445668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 14:34:16.461456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:16.464293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 14:34:16.466280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 14:34:16.466280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 14:34:16.466280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:16.466280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 641/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:16.469888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131393-2174-4ac8-9fee-5da70c1d94f6 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:16.577370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131393-2174-4ac8-9fee-5da70c1d94f6 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:16.615049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:16.615740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:16.616021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:16.616365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:16.617066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:16.617416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:16.618960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:16.632426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 643/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Aug 30 14:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:16.640134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:16.753525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1f82d-7701-4e57-ad83-212de02557d0 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:16.770138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:16.792791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:16.793489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:16.793802 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:16.794108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:16.801464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:16.802958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 14:34:16.814892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:16.816091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: ERROR keystone.server.flask.application Aug 30 14:34:16.817252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 642/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Aug 30 14:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:16.824255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:16.882230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:16.937367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434fd6b-5185-4b18-8151-ee8438c9ce53 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:16.975722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cacced-dac2-462e-9865-61fc62ee6149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:16.976340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cacced-dac2-462e-9865-61fc62ee6149 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:16.976609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cacced-dac2-462e-9865-61fc62ee6149 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:16.976873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cacced-dac2-462e-9865-61fc62ee6149 None admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:16.977568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cacced-dac2-462e-9865-61fc62ee6149 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:16.977871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cacced-dac2-462e-9865-61fc62ee6149 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:16.979477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cacced-dac2-462e-9865-61fc62ee6149 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:16.993901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 644/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Aug 30 14:34:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:17.000462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:17.132700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f8e61-b49d-4531-86a9-80603744c4bf None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:17.175687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a169fe-8105-4344-bec5-1b58b0453eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:17.176300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a169fe-8105-4344-bec5-1b58b0453eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:17.176571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a169fe-8105-4344-bec5-1b58b0453eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:17.176835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a169fe-8105-4344-bec5-1b58b0453eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:17.177570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a169fe-8105-4344-bec5-1b58b0453eb6 None admin] RBAC: Adding query filter params (role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d, scope.project.id=fabb84470909411f80adffac902dea45, user.id=64e595269cd746d68edd59783c1d6314) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:17.177872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a169fe-8105-4344-bec5-1b58b0453eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:17.179336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a169fe-8105-4344-bec5-1b58b0453eb6 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:17.185935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 643/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Aug 30 14:34:16 2022] GET /identity/v3/role_assignments?user.id=64e595269cd746d68edd59783c1d6314&scope.project.id=fabb84470909411f80adffac902dea45&role.id=c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:19.198854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63741f-e385-4b88-ae68-b4231924d01a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:19.199456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63741f-e385-4b88-ae68-b4231924d01a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:19.199456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63741f-e385-4b88-ae68-b4231924d01a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:19.200785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 645/1288] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:34:19.206530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad29da-6ea9-4dbf-bf40-357575a446d5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:19.207061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad29da-6ea9-4dbf-bf40-357575a446d5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:19.207306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad29da-6ea9-4dbf-bf40-357575a446d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:19.228779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-21ad29da-6ea9-4dbf-bf40-357575a446d5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:34:19.230056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-21ad29da-6ea9-4dbf-bf40-357575a446d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:34:19.272380 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:19.314363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 644/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:34:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 14:34:19.603000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63741f-e385-4b88-ae68-b4231924d01a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:19.711837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63741f-e385-4b88-ae68-b4231924d01a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:19.724218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:19.752074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:19.752705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:19.752999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:19.753291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:19.753872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:19.755450 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:19.764699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:19.766045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:19.767409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 646/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:34:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:19.772838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad29da-6ea9-4dbf-bf40-357575a446d5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:19.881037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad29da-6ea9-4dbf-bf40-357575a446d5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:19.918628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78737000-1983-494e-8981-4c3e28386e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:19.919241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78737000-1983-494e-8981-4c3e28386e4a None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:19.919513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78737000-1983-494e-8981-4c3e28386e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:19.919777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78737000-1983-494e-8981-4c3e28386e4a None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:19.920407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78737000-1983-494e-8981-4c3e28386e4a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:19.920700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78737000-1983-494e-8981-4c3e28386e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:19.922110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78737000-1983-494e-8981-4c3e28386e4a None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:19.927734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 645/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Aug 30 14:34:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:19.934872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:20.062183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8153-602b-49f3-860d-b6668b89e95c None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:20.109524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea537ca-afab-43b0-a614-65f3dac0b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:20.110423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea537ca-afab-43b0-a614-65f3dac0b061 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:20.110760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea537ca-afab-43b0-a614-65f3dac0b061 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:20.111154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea537ca-afab-43b0-a614-65f3dac0b061 None admin] PATH_INFO: `/v3/services` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:20.111996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea537ca-afab-43b0-a614-65f3dac0b061 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:20.112535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea537ca-afab-43b0-a614-65f3dac0b061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:20.115128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea537ca-afab-43b0-a614-65f3dac0b061 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:20.120765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 647/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Aug 30 14:34:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:22.061675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7be8-b984-4b91-bf36-12aeca39ff54 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:22.062231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7be8-b984-4b91-bf36-12aeca39ff54 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:22.062231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7be8-b984-4b91-bf36-12aeca39ff54 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:22.063659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 646/1293] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:34:22.069231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9dd5e-bd42-4324-9138-70d08e005fb8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:22.069693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9dd5e-bd42-4324-9138-70d08e005fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:22.069785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9dd5e-bd42-4324-9138-70d08e005fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:22.092678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7fd9dd5e-bd42-4324-9138-70d08e005fb8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:34:22.094290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7fd9dd5e-bd42-4324-9138-70d08e005fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:34:22.130755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:22.181097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 648/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:34:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:34:22.518466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7be8-b984-4b91-bf36-12aeca39ff54 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:22.557365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:22.646929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7be8-b984-4b91-bf36-12aeca39ff54 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:22.689873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f62cef-52e1-40cc-a79c-29b449129586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:22.691076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62cef-52e1-40cc-a79c-29b449129586 None admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:22.691655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62cef-52e1-40cc-a79c-29b449129586 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:22.692098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62cef-52e1-40cc-a79c-29b449129586 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:22.692946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f62cef-52e1-40cc-a79c-29b449129586 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:22.694743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f62cef-52e1-40cc-a79c-29b449129586 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:22.716058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 647/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Aug 30 14:34:22 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:34:24.949493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642d71-0d7d-46c8-b323-b7a588a13f6d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:24.950409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642d71-0d7d-46c8-b323-b7a588a13f6d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:24.950409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d642d71-0d7d-46c8-b323-b7a588a13f6d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:24.951446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 649/1296] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:34:24.957528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57e32-cb54-4788-b91f-bb7855f03526 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:24.958043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57e32-cb54-4788-b91f-bb7855f03526 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:24.958043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a57e32-cb54-4788-b91f-bb7855f03526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:24.978486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b9a57e32-cb54-4788-b91f-bb7855f03526 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:34:24.979735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b9a57e32-cb54-4788-b91f-bb7855f03526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:34:25.058877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 648/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:34:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:34:25.329129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d642d71-0d7d-46c8-b323-b7a588a13f6d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:25.507246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d642d71-0d7d-46c8-b323-b7a588a13f6d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:25.554355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:25.555249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:25.555535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:25.555842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:25.556657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:25.558364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:25.569444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:25.571792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:25.573359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 650/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:34:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 14:34:25.578830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57e32-cb54-4788-b91f-bb7855f03526 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:25.605029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:25.707177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a57e32-cb54-4788-b91f-bb7855f03526 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:25.747407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:25.748231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:25.748516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:25.748972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:25.749630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:25.749934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:25.751712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:25.758324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 649/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Aug 30 14:34:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:25.765929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:25.801912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:25.883780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286727f4-d2b5-42e1-9450-805461980e91 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:25.932057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792711c-0768-462a-87ca-a3a72b09f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:25.932695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792711c-0768-462a-87ca-a3a72b09f256 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:25.932994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792711c-0768-462a-87ca-a3a72b09f256 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:25.933258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792711c-0768-462a-87ca-a3a72b09f256 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:25.934053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792711c-0768-462a-87ca-a3a72b09f256 None admin] RBAC: Adding query filter params (interface=public, service_id=211bf5e09a3b491cbf094cd3aa06cf65, region_id=RegionOne) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:25.934361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792711c-0768-462a-87ca-a3a72b09f256 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:25.935787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792711c-0768-462a-87ca-a3a72b09f256 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:25.941855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 651/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Aug 30 14:34:25 2022] GET /identity/v3/endpoints?service_id=211bf5e09a3b491cbf094cd3aa06cf65&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:25.948417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:26.040816 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:26.062160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44295a20-49c6-48c9-a138-e3241021faf7 None admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:26.102819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6900d-3b62-4716-9f83-35fd70fc6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:26.103442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6900d-3b62-4716-9f83-35fd70fc6456 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:26.103715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6900d-3b62-4716-9f83-35fd70fc6456 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:26.104014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6900d-3b62-4716-9f83-35fd70fc6456 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:26.104601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6900d-3b62-4716-9f83-35fd70fc6456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:26.106110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6900d-3b62-4716-9f83-35fd70fc6456 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:26.113450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 650/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Aug 30 14:34:25 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:34:28.312342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a55d-7e28-4f26-9200-337945719d67 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:28.312980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a55d-7e28-4f26-9200-337945719d67 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:28.313107 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0a55d-7e28-4f26-9200-337945719d67 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:28.314541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 652/1302] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:34:28.321975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c02e3-437d-4f14-a2d5-e533ad1d9205 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:28.322504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c02e3-437d-4f14-a2d5-e533ad1d9205 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:28.322604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c02e3-437d-4f14-a2d5-e533ad1d9205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:28.348723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f73c02e3-437d-4f14-a2d5-e533ad1d9205 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:34:28.350413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f73c02e3-437d-4f14-a2d5-e533ad1d9205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:34:28.430051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 651/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:34:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 14:34:28.699691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0a55d-7e28-4f26-9200-337945719d67 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:28.805295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:28.812669 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0a55d-7e28-4f26-9200-337945719d67 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:28.849510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:28.850165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:28.850466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:28.850733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:28.851397 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:28.852792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 14:34:28.862989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 14:34:28.864421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application with Lock( Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self._enter() Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application return self.creator() Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application created_value = creator( Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: ERROR keystone.server.flask.application Aug 30 14:34:28.865346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 653/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Aug 30 14:34:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 14:34:28.871632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c02e3-437d-4f14-a2d5-e533ad1d9205 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:28.967317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:28.991711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c02e3-437d-4f14-a2d5-e533ad1d9205 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:29.027490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cbbbe-8443-472f-9aea-e69a2e392148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:29.028105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cbbbe-8443-472f-9aea-e69a2e392148 None admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:29.028382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cbbbe-8443-472f-9aea-e69a2e392148 None admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:29.028709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cbbbe-8443-472f-9aea-e69a2e392148 None admin] PATH_INFO: `/v3/services` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:29.029292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cbbbe-8443-472f-9aea-e69a2e392148 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:34:29.029589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cbbbe-8443-472f-9aea-e69a2e392148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:29.030991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cbbbe-8443-472f-9aea-e69a2e392148 None admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:29.036813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 652/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Aug 30 14:34:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:34:29.042911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:34:29.169615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d2e5-30d2-4786-98f6-ecc56b1442f9 None admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:34:29.205666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf34911-54f7-403d-8199-59a4b76ecc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:34:29.206913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34911-54f7-403d-8199-59a4b76ecc3d None admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:34:29.206913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34911-54f7-403d-8199-59a4b76ecc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:34:29.207160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34911-54f7-403d-8199-59a4b76ecc3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:34:29.207843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34911-54f7-403d-8199-59a4b76ecc3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:34:29.209275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34911-54f7-403d-8199-59a4b76ecc3d None admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:34:29.232848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 654/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:34:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:34:39.033251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=30 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:34:39.227135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:36.165599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409967d6-8bcf-4e3e-8033-42adec72bce9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:36.166496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409967d6-8bcf-4e3e-8033-42adec72bce9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:36.166909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409967d6-8bcf-4e3e-8033-42adec72bce9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:36.172831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 653/1307] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:35:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:36.176381 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609b70d-d624-41c4-8f50-0488d877ee0b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:36.176901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609b70d-d624-41c4-8f50-0488d877ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:36.177357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609b70d-d624-41c4-8f50-0488d877ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:36.313776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0609b70d-d624-41c4-8f50-0488d877ee0b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:36.316062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0609b70d-d624-41c4-8f50-0488d877ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:36.568106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 655/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:36.865738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d0d7c-1836-413b-8de1-88a23523aa09 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:36.865936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d0d7c-1836-413b-8de1-88a23523aa09 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:36.866300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d0d7c-1836-413b-8de1-88a23523aa09 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:36.867936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 654/1309] 10.222.0.49 () {54 vars in 965 bytes} [Tue Aug 30 14:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:36.875252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ecaaf-4776-416c-aa9b-3cd1f49219b0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:36.875542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ecaaf-4776-416c-aa9b-3cd1f49219b0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:36.875859 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ecaaf-4776-416c-aa9b-3cd1f49219b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:36.969790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-242ecaaf-4776-416c-aa9b-3cd1f49219b0 None None] MFA Rules not processed for user `6b24f12951bd4220afad25f23f566f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:36.971120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-242ecaaf-4776-416c-aa9b-3cd1f49219b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:36.997718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:37.090564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 656/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Tue Aug 30 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:37.101351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d0d7c-1836-413b-8de1-88a23523aa09 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:37.103568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f41d0d7c-1836-413b-8de1-88a23523aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:37.241182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d0d7c-1836-413b-8de1-88a23523aa09 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:37.356050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5557-45a9-4eaf-8f41-a29d554958a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:37.356964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5557-45a9-4eaf-8f41-a29d554958a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:37.357382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5557-45a9-4eaf-8f41-a29d554958a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:37.357838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5557-45a9-4eaf-8f41-a29d554958a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:37.359959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6a0a5557-45a9-4eaf-8f41-a29d554958a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:37.440935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:37.531469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a5557-45a9-4eaf-8f41-a29d554958a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:37.534469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a5557-45a9-4eaf-8f41-a29d554958a8 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:37.575655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 655/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:35:39.850492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6aee-2eb4-489c-a960-dda30635b291 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:39.851137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6aee-2eb4-489c-a960-dda30635b291 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:39.851137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6aee-2eb4-489c-a960-dda30635b291 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:39.852689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 657/1312] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:39.858454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854ce0-9f66-4547-8198-eea030cca53c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:39.858927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854ce0-9f66-4547-8198-eea030cca53c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:39.859343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854ce0-9f66-4547-8198-eea030cca53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:39.956726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ba854ce0-9f66-4547-8198-eea030cca53c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:39.958015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ba854ce0-9f66-4547-8198-eea030cca53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:40.065255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 656/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:40.359057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b114e1-f80b-49d9-8024-5bc82918d852 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:40.359335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b114e1-f80b-49d9-8024-5bc82918d852 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:40.359603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b114e1-f80b-49d9-8024-5bc82918d852 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:40.361185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 658/1314] 10.222.0.49 () {54 vars in 965 bytes} [Tue Aug 30 14:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:35:40.367710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcfe5-d90b-4ab0-bf3a-7d2842b38183 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:40.368084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcfe5-d90b-4ab0-bf3a-7d2842b38183 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:40.368456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcfe5-d90b-4ab0-bf3a-7d2842b38183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:40.382055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:40.461696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6f4fcfe5-d90b-4ab0-bf3a-7d2842b38183 None None] MFA Rules not processed for user `6b24f12951bd4220afad25f23f566f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:40.462968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6f4fcfe5-d90b-4ab0-bf3a-7d2842b38183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:40.548018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 657/1315] 10.222.0.49 () {58 vars in 1062 bytes} [Tue Aug 30 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:40.557260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b114e1-f80b-49d9-8024-5bc82918d852 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:40.558822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-66b114e1-f80b-49d9-8024-5bc82918d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:40.670144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b114e1-f80b-49d9-8024-5bc82918d852 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:40.752189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:40.755061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc908817-bc4e-4977-8d50-bbaa9ef5f48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:40.755695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908817-bc4e-4977-8d50-bbaa9ef5f48d service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:40.755974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908817-bc4e-4977-8d50-bbaa9ef5f48d service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:40.756249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908817-bc4e-4977-8d50-bbaa9ef5f48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:40.758508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cc908817-bc4e-4977-8d50-bbaa9ef5f48d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:40.873114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc908817-bc4e-4977-8d50-bbaa9ef5f48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:40.874660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc908817-bc4e-4977-8d50-bbaa9ef5f48d service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:40.894362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 659/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:35:43.330975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c6e0-52a9-4551-a6d1-1e26e22574f1 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:43.331526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c6e0-52a9-4551-a6d1-1e26e22574f1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:43.331776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c6e0-52a9-4551-a6d1-1e26e22574f1 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:43.334183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 658/1317] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:43.340985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734c07c-a332-4c07-aadc-c74fe004342d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:43.341500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734c07c-a332-4c07-aadc-c74fe004342d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:43.341612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734c07c-a332-4c07-aadc-c74fe004342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:43.411949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b734c07c-a332-4c07-aadc-c74fe004342d None None] MFA Rules not processed for user `8c7c471adf5d45d9bc0f2ee644a28cad`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:43.413186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b734c07c-a332-4c07-aadc-c74fe004342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:43.472719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:43.524637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 660/1318] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:43.809798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798c6e0-52a9-4551-a6d1-1e26e22574f1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:43.811363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c798c6e0-52a9-4551-a6d1-1e26e22574f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:43.920165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798c6e0-52a9-4551-a6d1-1e26e22574f1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:43.923003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:43.998516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0fb63-f8c7-4f38-88e5-8425077a4b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:43.999127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fb63-f8c7-4f38-88e5-8425077a4b63 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:43.999411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fb63-f8c7-4f38-88e5-8425077a4b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:43.999677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0fb63-f8c7-4f38-88e5-8425077a4b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:44.001286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3ae0fb63-f8c7-4f38-88e5-8425077a4b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:44.120238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0fb63-f8c7-4f38-88e5-8425077a4b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:44.121586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0fb63-f8c7-4f38-88e5-8425077a4b63 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:44.142403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 659/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:35:46.859812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bee00-8aba-461c-a9a0-fd55c6414773 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:46.860409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bee00-8aba-461c-a9a0-fd55c6414773 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:46.860409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bee00-8aba-461c-a9a0-fd55c6414773 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:46.861760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 661/1320] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:46.868033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe0f4-2957-4d41-b5d4-e38fdc5b3dab None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:46.868540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe0f4-2957-4d41-b5d4-e38fdc5b3dab None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:46.868540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebe0f4-2957-4d41-b5d4-e38fdc5b3dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:46.914069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:46.942414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-eeebe0f4-2957-4d41-b5d4-e38fdc5b3dab None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:46.943744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-eeebe0f4-2957-4d41-b5d4-e38fdc5b3dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:47.050545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 660/1321] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:47.336701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bee00-8aba-461c-a9a0-fd55c6414773 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:47.338818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-345bee00-8aba-461c-a9a0-fd55c6414773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:47.466678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bee00-8aba-461c-a9a0-fd55c6414773 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:47.546363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3b8de-07b2-4829-ab02-2ad09723227d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:47.547007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b8de-07b2-4829-ab02-2ad09723227d service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:47.547285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b8de-07b2-4829-ab02-2ad09723227d service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:47.547555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b8de-07b2-4829-ab02-2ad09723227d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:47.549152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-39f3b8de-07b2-4829-ab02-2ad09723227d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:47.557360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:47.668192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3b8de-07b2-4829-ab02-2ad09723227d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:47.669565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3b8de-07b2-4829-ab02-2ad09723227d service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:47.690608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 662/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:35:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:35:50.339445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b56de-98f7-4dcc-9a5c-69023669beb1 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:50.340072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b56de-98f7-4dcc-9a5c-69023669beb1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:50.340072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b56de-98f7-4dcc-9a5c-69023669beb1 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:50.341891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 661/1323] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:50.348248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7c50-d179-4480-a04c-4884c524a59d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:50.349099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7c50-d179-4480-a04c-4884c524a59d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:50.349099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7c50-d179-4480-a04c-4884c524a59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:50.421986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f6ef7c50-d179-4480-a04c-4884c524a59d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:50.423226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f6ef7c50-d179-4480-a04c-4884c524a59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:50.489383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:50.533734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 663/1324] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:50.826181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b56de-98f7-4dcc-9a5c-69023669beb1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:50.827878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9b8b56de-98f7-4dcc-9a5c-69023669beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:50.953728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b56de-98f7-4dcc-9a5c-69023669beb1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:50.966935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:51.043500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7172e8-d6bd-41fe-90b6-4a294b9a2466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:51.044124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7172e8-d6bd-41fe-90b6-4a294b9a2466 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:51.044399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7172e8-d6bd-41fe-90b6-4a294b9a2466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:51.044656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7172e8-d6bd-41fe-90b6-4a294b9a2466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:51.046311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0c7172e8-d6bd-41fe-90b6-4a294b9a2466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:51.171210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7172e8-d6bd-41fe-90b6-4a294b9a2466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:51.172492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7172e8-d6bd-41fe-90b6-4a294b9a2466 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:51.201211 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 662/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:35:53.272695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e1d8-b26a-440a-b9fb-9c9019e9e863 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:53.273266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e1d8-b26a-440a-b9fb-9c9019e9e863 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:53.273266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e1d8-b26a-440a-b9fb-9c9019e9e863 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:53.274527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 664/1326] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:53.280671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19f54-a076-42ae-83b2-71670845ed13 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:53.281225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19f54-a076-42ae-83b2-71670845ed13 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:53.281322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19f54-a076-42ae-83b2-71670845ed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:53.333116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:53.355819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9ba19f54-a076-42ae-83b2-71670845ed13 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:53.357053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9ba19f54-a076-42ae-83b2-71670845ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:53.475153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 663/1327] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:53.767181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e1d8-b26a-440a-b9fb-9c9019e9e863 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:53.769507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cde6e1d8-b26a-440a-b9fb-9c9019e9e863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:53.901083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e1d8-b26a-440a-b9fb-9c9019e9e863 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:54.002258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed8903-1929-4a88-b7eb-3e00c765e32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:54.003316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed8903-1929-4a88-b7eb-3e00c765e32f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:54.003779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed8903-1929-4a88-b7eb-3e00c765e32f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:54.004128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed8903-1929-4a88-b7eb-3e00c765e32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:54.007047 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-01ed8903-1929-4a88-b7eb-3e00c765e32f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:54.033220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:54.157187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed8903-1929-4a88-b7eb-3e00c765e32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:54.158615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed8903-1929-4a88-b7eb-3e00c765e32f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:54.178807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 665/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:35:56.263340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb21169-a138-4fec-bc55-5e91cd6a49fc None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:56.264131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb21169-a138-4fec-bc55-5e91cd6a49fc None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:56.264131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb21169-a138-4fec-bc55-5e91cd6a49fc None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:56.266298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 664/1329] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:35:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:35:56.274616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc9f7c-f0d8-4934-a816-bc68e2b00ba0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:56.275427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc9f7c-f0d8-4934-a816-bc68e2b00ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:56.275606 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc9f7c-f0d8-4934-a816-bc68e2b00ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:56.357061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9cbc9f7c-f0d8-4934-a816-bc68e2b00ba0 None None] MFA Rules not processed for user `8c7c471adf5d45d9bc0f2ee644a28cad`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:56.358368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9cbc9f7c-f0d8-4934-a816-bc68e2b00ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:56.439978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:56.478549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 666/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:35:56.759378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb21169-a138-4fec-bc55-5e91cd6a49fc None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:35:56.760947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ceb21169-a138-4fec-bc55-5e91cd6a49fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:56.877966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb21169-a138-4fec-bc55-5e91cd6a49fc None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:35:56.900716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:56.977398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd2610-2c4e-4644-bf79-97446afa3012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:35:56.978615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2610-2c4e-4644-bf79-97446afa3012 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:56.979079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2610-2c4e-4644-bf79-97446afa3012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:56.979579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2610-2c4e-4644-bf79-97446afa3012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:56.981406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e5dd2610-2c4e-4644-bf79-97446afa3012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:57.126919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd2610-2c4e-4644-bf79-97446afa3012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:35:57.128399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd2610-2c4e-4644-bf79-97446afa3012 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:35:57.150920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 665/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:35:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:35:59.498052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5de7-2f3b-4999-96d5-d818675467b6 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.498973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5de7-2f3b-4999-96d5-d818675467b6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.498973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5de7-2f3b-4999-96d5-d818675467b6 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.500687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 667/1332] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:35:59.507532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78c9fa-c857-4edb-827a-7bae8198c7e6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:35:59.508334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78c9fa-c857-4edb-827a-7bae8198c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:35:59.508334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78c9fa-c857-4edb-827a-7bae8198c7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:35:59.583477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:59.587313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-bd78c9fa-c857-4edb-827a-7bae8198c7e6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:35:59.589201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bd78c9fa-c857-4edb-827a-7bae8198c7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:35:59.735107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 666/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:00.245212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5de7-2f3b-4999-96d5-d818675467b6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:00.247959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-26da5de7-2f3b-4999-96d5-d818675467b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:00.390034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5de7-2f3b-4999-96d5-d818675467b6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:00.477525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2423b6-e575-4194-bad5-d9e5abc7520b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:00.478148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2423b6-e575-4194-bad5-d9e5abc7520b service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:00.478430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2423b6-e575-4194-bad5-d9e5abc7520b service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:00.478731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2423b6-e575-4194-bad5-d9e5abc7520b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:00.480377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5b2423b6-e575-4194-bad5-d9e5abc7520b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:00.511501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:00.607668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2423b6-e575-4194-bad5-d9e5abc7520b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:00.609154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2423b6-e575-4194-bad5-d9e5abc7520b service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:00.632005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 668/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:02.645012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781f35b-1c46-4f90-9dc7-b7f2c450f76a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:02.646092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781f35b-1c46-4f90-9dc7-b7f2c450f76a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:02.646471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781f35b-1c46-4f90-9dc7-b7f2c450f76a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:02.647944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 667/1335] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:02.654057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a64b-fd4c-4b89-bea8-997d0a396cb0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:02.654678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a64b-fd4c-4b89-bea8-997d0a396cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:02.654678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a64b-fd4c-4b89-bea8-997d0a396cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:02.731699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1c06a64b-fd4c-4b89-bea8-997d0a396cb0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:02.732851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1c06a64b-fd4c-4b89-bea8-997d0a396cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:02.838868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:02.866950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 669/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:03.187056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781f35b-1c46-4f90-9dc7-b7f2c450f76a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:03.188701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d781f35b-1c46-4f90-9dc7-b7f2c450f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:03.301131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781f35b-1c46-4f90-9dc7-b7f2c450f76a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:03.332284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:03.380195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8297b5-df36-49b5-9cbc-c5ce899619f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:03.380811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8297b5-df36-49b5-9cbc-c5ce899619f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:03.381082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8297b5-df36-49b5-9cbc-c5ce899619f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:03.381418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8297b5-df36-49b5-9cbc-c5ce899619f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:03.382981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3c8297b5-df36-49b5-9cbc-c5ce899619f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:03.497192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8297b5-df36-49b5-9cbc-c5ce899619f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:03.498707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8297b5-df36-49b5-9cbc-c5ce899619f3 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:03.519852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 668/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:36:05.984403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b284ce-78d6-4075-af5f-3840b3c09b5f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:05.985015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b284ce-78d6-4075-af5f-3840b3c09b5f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:05.985015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b284ce-78d6-4075-af5f-3840b3c09b5f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:05.986351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 670/1338] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:05.992453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192fecb-6f80-46a1-9fb0-9a5195a57ee7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:05.992958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192fecb-6f80-46a1-9fb0-9a5195a57ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:05.993066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192fecb-6f80-46a1-9fb0-9a5195a57ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:06.066478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5192fecb-6f80-46a1-9fb0-9a5195a57ee7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:06.067778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5192fecb-6f80-46a1-9fb0-9a5195a57ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:06.077050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:06.168966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 669/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:06.452852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b284ce-78d6-4075-af5f-3840b3c09b5f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:06.454479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f9b284ce-78d6-4075-af5f-3840b3c09b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:06.574837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b284ce-78d6-4075-af5f-3840b3c09b5f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:06.658803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1ad8e-0f4c-46be-85bc-4fd82c67ccc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:06.659423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1ad8e-0f4c-46be-85bc-4fd82c67ccc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:06.659703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1ad8e-0f4c-46be-85bc-4fd82c67ccc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:06.659974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1ad8e-0f4c-46be-85bc-4fd82c67ccc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:06.662354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-38e1ad8e-0f4c-46be-85bc-4fd82c67ccc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:06.705526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:06.786615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1ad8e-0f4c-46be-85bc-4fd82c67ccc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:06.788075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1ad8e-0f4c-46be-85bc-4fd82c67ccc6 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:06.807077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 671/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:11.020775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327fda-d9b1-4ddf-a1d2-b50486d40456 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.021317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327fda-d9b1-4ddf-a1d2-b50486d40456 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.021317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327fda-d9b1-4ddf-a1d2-b50486d40456 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.022574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 670/1341] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:11.028377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4e74a-689d-4ca8-857c-6c711c31b9d1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.028811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4e74a-689d-4ca8-857c-6c711c31b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.028949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4e74a-689d-4ca8-857c-6c711c31b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.104136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b3f4e74a-689d-4ca8-857c-6c711c31b9d1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:11.105502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b3f4e74a-689d-4ca8-857c-6c711c31b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:11.206625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.220178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 672/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:11.526533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5327fda-d9b1-4ddf-a1d2-b50486d40456 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:11.528065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c5327fda-d9b1-4ddf-a1d2-b50486d40456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:11.646351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5327fda-d9b1-4ddf-a1d2-b50486d40456 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:11.688902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:11.729107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3475c-8a5f-447b-a884-d64b5b431c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:11.729832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3475c-8a5f-447b-a884-d64b5b431c00 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:11.730182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3475c-8a5f-447b-a884-d64b5b431c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:11.730565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3475c-8a5f-447b-a884-d64b5b431c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:11.732232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-08e3475c-8a5f-447b-a884-d64b5b431c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:11.849131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3475c-8a5f-447b-a884-d64b5b431c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:11.850610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3475c-8a5f-447b-a884-d64b5b431c00 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:11.870924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 671/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:14.475173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38e00-fea5-4018-b442-f94038feaf2c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:14.475910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38e00-fea5-4018-b442-f94038feaf2c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:14.475910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab38e00-fea5-4018-b442-f94038feaf2c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:14.477112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 673/1344] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:14.483120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcbb3b-c9cf-40db-a3e6-355196953e22 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:14.483648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcbb3b-c9cf-40db-a3e6-355196953e22 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:14.483648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcbb3b-c9cf-40db-a3e6-355196953e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:14.559198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7afcbb3b-c9cf-40db-a3e6-355196953e22 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:14.560407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7afcbb3b-c9cf-40db-a3e6-355196953e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:14.581770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:14.669849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 672/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:14.948083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab38e00-fea5-4018-b442-f94038feaf2c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:14.949708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bab38e00-fea5-4018-b442-f94038feaf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:15.078895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab38e00-fea5-4018-b442-f94038feaf2c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:15.164511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158d0df-e4ed-46d7-98d0-610210309147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:15.165137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d0df-e4ed-46d7-98d0-610210309147 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:15.165409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d0df-e4ed-46d7-98d0-610210309147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:15.165671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d0df-e4ed-46d7-98d0-610210309147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:15.167468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5158d0df-e4ed-46d7-98d0-610210309147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:15.217555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:15.301491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158d0df-e4ed-46d7-98d0-610210309147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:15.303010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158d0df-e4ed-46d7-98d0-610210309147 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:15.330466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 674/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:19.536717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1293c7-3046-4fef-a789-2a2f6d86f4a9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:19.537293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1293c7-3046-4fef-a789-2a2f6d86f4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:19.537293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1293c7-3046-4fef-a789-2a2f6d86f4a9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:19.539853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 673/1347] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:19.544819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d8b9-ed62-4c10-905f-8c037ab307e1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:19.545309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d8b9-ed62-4c10-905f-8c037ab307e1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:19.545309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d8b9-ed62-4c10-905f-8c037ab307e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:19.621211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d197d8b9-ed62-4c10-905f-8c037ab307e1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:19.622472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d197d8b9-ed62-4c10-905f-8c037ab307e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:19.741830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:19.744929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 675/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:36:20.026749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1293c7-3046-4fef-a789-2a2f6d86f4a9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:20.028730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6c1293c7-3046-4fef-a789-2a2f6d86f4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:20.149073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1293c7-3046-4fef-a789-2a2f6d86f4a9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:20.210750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:20.245079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062babe-8245-4087-b792-0f2901831b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:20.245705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062babe-8245-4087-b792-0f2901831b89 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:20.246005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062babe-8245-4087-b792-0f2901831b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:20.246269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062babe-8245-4087-b792-0f2901831b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:20.247952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c062babe-8245-4087-b792-0f2901831b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:20.369215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062babe-8245-4087-b792-0f2901831b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:20.370693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062babe-8245-4087-b792-0f2901831b89 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:20.390306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 674/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:36:25.448281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3edb0-2a29-47d5-8fba-659c36023188 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.448791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3edb0-2a29-47d5-8fba-659c36023188 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.448903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3edb0-2a29-47d5-8fba-659c36023188 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.450977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 676/1350] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:25.457031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66bc8-4ec8-4faa-8173-d66fa09ba9b2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:25.457702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66bc8-4ec8-4faa-8173-d66fa09ba9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:25.457702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66bc8-4ec8-4faa-8173-d66fa09ba9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:25.559210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-dad66bc8-4ec8-4faa-8173-d66fa09ba9b2 None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:25.561710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dad66bc8-4ec8-4faa-8173-d66fa09ba9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:25.587807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:25.702605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 675/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:36:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:30.291405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c8301-3574-4c11-a44e-ec0e0e7e2d57 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.292021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c8301-3574-4c11-a44e-ec0e0e7e2d57 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.292021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c8301-3574-4c11-a44e-ec0e0e7e2d57 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.293601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 677/1352] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:30.299574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d525a2e-fd1f-4921-8363-d2567485a2e7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:30.300138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d525a2e-fd1f-4921-8363-d2567485a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:30.300269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d525a2e-fd1f-4921-8363-d2567485a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:30.389126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4d525a2e-fd1f-4921-8363-d2567485a2e7 None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:30.390347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4d525a2e-fd1f-4921-8363-d2567485a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:30.469255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:30.512557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 676/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:36:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:31.821267 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfda40-e3d7-4775-bf85-7a78cff11aa5 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.821839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfda40-e3d7-4775-bf85-7a78cff11aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.821839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfda40-e3d7-4775-bf85-7a78cff11aa5 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.823173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 678/1354] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:31.828769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b1645-1f9f-4f11-b3fc-7d003df64d03 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:31.829264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b1645-1f9f-4f11-b3fc-7d003df64d03 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:31.829264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b1645-1f9f-4f11-b3fc-7d003df64d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:31.919715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-154b1645-1f9f-4f11-b3fc-7d003df64d03 None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:31.921072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-154b1645-1f9f-4f11-b3fc-7d003df64d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:32.032701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 677/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:35.500238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369f56-a678-4ba8-a077-b3d87f4d6efc None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:35.501573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369f56-a678-4ba8-a077-b3d87f4d6efc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:35.501872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94369f56-a678-4ba8-a077-b3d87f4d6efc None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:35.504589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 679/1356] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:35.509962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b946-1456-4349-80ea-5202d38589ee None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:35.510483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b946-1456-4349-80ea-5202d38589ee None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:35.510602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b946-1456-4349-80ea-5202d38589ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:35.553446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:35.596233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fff2b946-1456-4349-80ea-5202d38589ee None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:35.597454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fff2b946-1456-4349-80ea-5202d38589ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:35.745137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 678/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:36.063164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fa839-7c16-4837-9858-75e1b9661d5c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.064115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fa839-7c16-4837-9858-75e1b9661d5c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.064807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fa839-7c16-4837-9858-75e1b9661d5c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.071266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 680/1358] 10.222.0.49 () {54 vars in 962 bytes} [Tue Aug 30 14:36:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:36.092034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee0a76-3836-48b0-9cf1-b09d289c7c40 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.092319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee0a76-3836-48b0-9cf1-b09d289c7c40 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.092569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee0a76-3836-48b0-9cf1-b09d289c7c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.197031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d5ee0a76-3836-48b0-9cf1-b09d289c7c40 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:36.199836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d5ee0a76-3836-48b0-9cf1-b09d289c7c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:36.259881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:36.361888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 679/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Aug 30 14:36:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:36.371502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fa839-7c16-4837-9858-75e1b9661d5c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:36.373127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ea2fa839-7c16-4837-9858-75e1b9661d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:36.571930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fa839-7c16-4837-9858-75e1b9661d5c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:36.673115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:36.744318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846e2a2-a875-4dc3-a740-3a958e9c8ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:36.745177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846e2a2-a875-4dc3-a740-3a958e9c8ce1 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:36.745459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846e2a2-a875-4dc3-a740-3a958e9c8ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:36.745888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846e2a2-a875-4dc3-a740-3a958e9c8ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:36.748262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d846e2a2-a875-4dc3-a740-3a958e9c8ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:36.883713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846e2a2-a875-4dc3-a740-3a958e9c8ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:36.887639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846e2a2-a875-4dc3-a740-3a958e9c8ce1 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:36.917454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 681/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:36:39.313415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8ce53-07d8-485a-b07a-e56c6f9bc7ce None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.314192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8ce53-07d8-485a-b07a-e56c6f9bc7ce None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.314192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8ce53-07d8-485a-b07a-e56c6f9bc7ce None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.315580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 680/1361] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:39.321619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3776a-0f36-47b7-ac12-254fcc822d07 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:39.322315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3776a-0f36-47b7-ac12-254fcc822d07 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:39.322315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3776a-0f36-47b7-ac12-254fcc822d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:39.417015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-37e3776a-0f36-47b7-ac12-254fcc822d07 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:39.419051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-37e3776a-0f36-47b7-ac12-254fcc822d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:39.497554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:39.637861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 682/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:36:40.086991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8ce53-07d8-485a-b07a-e56c6f9bc7ce None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:40.089223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8ce8ce53-07d8-485a-b07a-e56c6f9bc7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:40.291425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8ce53-07d8-485a-b07a-e56c6f9bc7ce None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:40.304014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:40.511447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36316f1a-7465-47fd-aa01-8c8a65d64c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:40.512263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36316f1a-7465-47fd-aa01-8c8a65d64c71 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:40.512392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36316f1a-7465-47fd-aa01-8c8a65d64c71 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:40.512562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36316f1a-7465-47fd-aa01-8c8a65d64c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:40.514285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-36316f1a-7465-47fd-aa01-8c8a65d64c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:40.626268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36316f1a-7465-47fd-aa01-8c8a65d64c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:40.627935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36316f1a-7465-47fd-aa01-8c8a65d64c71 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:40.650690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 681/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:42.943199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb37c-d72c-4fae-ba0f-52caf116f128 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.943770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb37c-d72c-4fae-ba0f-52caf116f128 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.943770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edb37c-d72c-4fae-ba0f-52caf116f128 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.945268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 683/1364] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:42.951546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46025f-878f-4bb8-a042-7203a715a3f0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:42.952082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46025f-878f-4bb8-a042-7203a715a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:42.952082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46025f-878f-4bb8-a042-7203a715a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:42.970444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.036754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6b46025f-878f-4bb8-a042-7203a715a3f0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:43.038257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6b46025f-878f-4bb8-a042-7203a715a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:43.192884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 682/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:43.531034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586d5d-06df-452e-86dd-29a14e69816f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.531298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586d5d-06df-452e-86dd-29a14e69816f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.531692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586d5d-06df-452e-86dd-29a14e69816f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.533312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 684/1366] 10.222.0.49 () {54 vars in 962 bytes} [Tue Aug 30 14:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:43.540382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810de3-06ae-42c3-b3d1-7d422dc22248 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:43.540706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810de3-06ae-42c3-b3d1-7d422dc22248 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:43.540939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810de3-06ae-42c3-b3d1-7d422dc22248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:43.628358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2f810de3-06ae-42c3-b3d1-7d422dc22248 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:43.629555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2f810de3-06ae-42c3-b3d1-7d422dc22248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:43.668064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:43.761150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 683/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Aug 30 14:36:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:43.770398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77586d5d-06df-452e-86dd-29a14e69816f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:43.772051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-77586d5d-06df-452e-86dd-29a14e69816f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:43.945012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77586d5d-06df-452e-86dd-29a14e69816f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:43.968454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:44.073367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf81db4-2d8a-4905-a3ad-a36432734d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:44.073990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf81db4-2d8a-4905-a3ad-a36432734d37 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:44.074228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf81db4-2d8a-4905-a3ad-a36432734d37 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:44.074564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf81db4-2d8a-4905-a3ad-a36432734d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:44.076274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-acf81db4-2d8a-4905-a3ad-a36432734d37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:44.185834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf81db4-2d8a-4905-a3ad-a36432734d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:44.187491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf81db4-2d8a-4905-a3ad-a36432734d37 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:44.211660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 685/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:36:45.433733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9906ed-4533-445a-8b61-12dda0c3e5eb None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.434324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9906ed-4533-445a-8b61-12dda0c3e5eb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.434324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9906ed-4533-445a-8b61-12dda0c3e5eb None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.435908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 684/1369] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:45.442274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81ca7f-0e5c-42d5-8952-655c99bafa61 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:45.443395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81ca7f-0e5c-42d5-8952-655c99bafa61 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:45.443395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81ca7f-0e5c-42d5-8952-655c99bafa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:45.483152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:45.547703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bd81ca7f-0e5c-42d5-8952-655c99bafa61 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:45.549062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bd81ca7f-0e5c-42d5-8952-655c99bafa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:45.690655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 686/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:36:46.254349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f548e-33fc-4c99-98d9-4fc80e5ef3da None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.254706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f548e-33fc-4c99-98d9-4fc80e5ef3da None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.254972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f548e-33fc-4c99-98d9-4fc80e5ef3da None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.256499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 685/1371] 10.222.0.49 () {54 vars in 964 bytes} [Tue Aug 30 14:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:46.261884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae6ec-0cb8-4f4e-8703-1825d4749e6e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.262205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae6ec-0cb8-4f4e-8703-1825d4749e6e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.262483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae6ec-0cb8-4f4e-8703-1825d4749e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.266257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cd69-6338-42dc-b06c-720d5f9562e3 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.266652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cd69-6338-42dc-b06c-720d5f9562e3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.267017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cd69-6338-42dc-b06c-720d5f9562e3 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.269735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 686/1372] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:46.275351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf596-ad34-448f-9f46-097ecdd0e75c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.276100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf596-ad34-448f-9f46-097ecdd0e75c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.276381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf596-ad34-448f-9f46-097ecdd0e75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.369835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7adcf596-ad34-448f-9f46-097ecdd0e75c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:46.370740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c4aae6ec-0cb8-4f4e-8703-1825d4749e6e None None] MFA Rules not processed for user `a725ee4d8b0b4524ad8484c3255f75da`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:46.371126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7adcf596-ad34-448f-9f46-097ecdd0e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.372189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c4aae6ec-0cb8-4f4e-8703-1825d4749e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.432514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.469567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 687/1373] 10.222.0.49 () {58 vars in 1061 bytes} [Tue Aug 30 14:36:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:36:46.482411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae6ec-0cb8-4f4e-8703-1825d4749e6e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.492300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae6ec-0cb8-4f4e-8703-1825d4749e6e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:46.507737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.515826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 687/1374] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:46.594729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111db85-8bab-4576-9954-fb771fa40919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:46.595887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111db85-8bab-4576-9954-fb771fa40919 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:46.596167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111db85-8bab-4576-9954-fb771fa40919 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:46.596438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111db85-8bab-4576-9954-fb771fa40919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:46.598868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6111db85-8bab-4576-9954-fb771fa40919 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.774843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111db85-8bab-4576-9954-fb771fa40919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:46.776611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111db85-8bab-4576-9954-fb771fa40919 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:46.797445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:46.810734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf596-ad34-448f-9f46-097ecdd0e75c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:46.811238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7adcf596-ad34-448f-9f46-097ecdd0e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:46.815285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 688/1375] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:36:46.980120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf596-ad34-448f-9f46-097ecdd0e75c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:47.111289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:47.124420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f457d-297b-4f98-beb2-c0e4a69018a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:47.125040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f457d-297b-4f98-beb2-c0e4a69018a0 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:47.125318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f457d-297b-4f98-beb2-c0e4a69018a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:47.125586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f457d-297b-4f98-beb2-c0e4a69018a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:47.127241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-076f457d-297b-4f98-beb2-c0e4a69018a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:47.227790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f457d-297b-4f98-beb2-c0e4a69018a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:47.229304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f457d-297b-4f98-beb2-c0e4a69018a0 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:47.248592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 688/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:49.279374 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289487e-a2d6-4855-bd01-d1b52e63adb9 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.279876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289487e-a2d6-4855-bd01-d1b52e63adb9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.279970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289487e-a2d6-4855-bd01-d1b52e63adb9 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.281355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 689/1377] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:49.288445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeba58-5dfd-4ada-9031-ab8793c91af4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:49.288445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeba58-5dfd-4ada-9031-ab8793c91af4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:49.288445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeba58-5dfd-4ada-9031-ab8793c91af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:49.381838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0efeba58-5dfd-4ada-9031-ab8793c91af4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:49.383303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0efeba58-5dfd-4ada-9031-ab8793c91af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:49.463105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:49.519011 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 689/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:49.837140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289487e-a2d6-4855-bd01-d1b52e63adb9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:49.838879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1289487e-a2d6-4855-bd01-d1b52e63adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:50.062667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289487e-a2d6-4855-bd01-d1b52e63adb9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:50.171013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:50.231282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1a27-834a-4146-9539-9690e99d9da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:50.231992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1a27-834a-4146-9539-9690e99d9da3 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:50.232333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1a27-834a-4146-9539-9690e99d9da3 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:50.232677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1a27-834a-4146-9539-9690e99d9da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:50.234478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-959c1a27-834a-4146-9539-9690e99d9da3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:50.349794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1a27-834a-4146-9539-9690e99d9da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:50.351765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1a27-834a-4146-9539-9690e99d9da3 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:50.378840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 690/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:52.555750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde80cba-0fee-4090-9ed8-01d0faf7e309 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.556382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde80cba-0fee-4090-9ed8-01d0faf7e309 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.557041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde80cba-0fee-4090-9ed8-01d0faf7e309 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.560038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 690/1380] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:52.565713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246175e-917d-48cc-ac93-a5e2871bbb43 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:52.566690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246175e-917d-48cc-ac93-a5e2871bbb43 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:52.566690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246175e-917d-48cc-ac93-a5e2871bbb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:52.655170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c246175e-917d-48cc-ac93-a5e2871bbb43 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:52.656656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c246175e-917d-48cc-ac93-a5e2871bbb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:52.711099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:52.830434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 691/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:53.363275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde80cba-0fee-4090-9ed8-01d0faf7e309 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:53.366071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cde80cba-0fee-4090-9ed8-01d0faf7e309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:53.596776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde80cba-0fee-4090-9ed8-01d0faf7e309 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:53.670284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:53.773665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2333d6-9f1f-437c-945c-69831a143a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:53.774296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2333d6-9f1f-437c-945c-69831a143a4d service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:53.774599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2333d6-9f1f-437c-945c-69831a143a4d service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:53.774868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2333d6-9f1f-437c-945c-69831a143a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:53.776581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cf2333d6-9f1f-437c-945c-69831a143a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:53.897362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2333d6-9f1f-437c-945c-69831a143a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:53.899468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2333d6-9f1f-437c-945c-69831a143a4d service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:53.939984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 691/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:56.212203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6e24-e844-470c-b599-c2dc5f902529 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.212927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6e24-e844-470c-b599-c2dc5f902529 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.212927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6e24-e844-470c-b599-c2dc5f902529 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.214995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 692/1383] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:56.222193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a7f7-4971-4e0b-8c24-6533a1685b6e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:56.223008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a7f7-4971-4e0b-8c24-6533a1685b6e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:56.223008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a7f7-4971-4e0b-8c24-6533a1685b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:56.307464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-52a2a7f7-4971-4e0b-8c24-6533a1685b6e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:56.309610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-52a2a7f7-4971-4e0b-8c24-6533a1685b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:56.313464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:56.457630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 692/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:36:56.770292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6e24-e844-470c-b599-c2dc5f902529 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:36:56.773488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bffe6e24-e844-470c-b599-c2dc5f902529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:57.004095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6e24-e844-470c-b599-c2dc5f902529 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:36:57.033312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:57.178527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625359-098c-490c-a93e-d64b95b770c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:36:57.179196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625359-098c-490c-a93e-d64b95b770c0 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:57.179473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625359-098c-490c-a93e-d64b95b770c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:57.179784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625359-098c-490c-a93e-d64b95b770c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:57.181520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-47625359-098c-490c-a93e-d64b95b770c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:57.324453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47625359-098c-490c-a93e-d64b95b770c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:36:57.327829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47625359-098c-490c-a93e-d64b95b770c0 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:36:57.360384 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 693/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:59.753363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa29bad-844a-4e45-8c06-53ca57a21ca9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.754146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa29bad-844a-4e45-8c06-53ca57a21ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.754146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa29bad-844a-4e45-8c06-53ca57a21ca9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.755478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 693/1386] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:36:59.761339 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fbe1b-d3b6-488f-ad73-7562b68cf406 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:36:59.762021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fbe1b-d3b6-488f-ad73-7562b68cf406 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:36:59.762021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fbe1b-d3b6-488f-ad73-7562b68cf406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:36:59.793481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:59.850432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9a8fbe1b-d3b6-488f-ad73-7562b68cf406 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:36:59.852253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9a8fbe1b-d3b6-488f-ad73-7562b68cf406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:36:59.986402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 694/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:00.283861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa29bad-844a-4e45-8c06-53ca57a21ca9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:00.285600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3aa29bad-844a-4e45-8c06-53ca57a21ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:00.481770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:00.506326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa29bad-844a-4e45-8c06-53ca57a21ca9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:00.672206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f8efa-637a-4f55-85f8-0b3dd438902e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:00.672847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f8efa-637a-4f55-85f8-0b3dd438902e service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:00.673134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f8efa-637a-4f55-85f8-0b3dd438902e service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:00.673399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f8efa-637a-4f55-85f8-0b3dd438902e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:00.675372 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-765f8efa-637a-4f55-85f8-0b3dd438902e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:00.792434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f8efa-637a-4f55-85f8-0b3dd438902e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:00.794702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f8efa-637a-4f55-85f8-0b3dd438902e service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:00.802683 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:00.826718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 694/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:02.860965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2620-f61e-428b-b21a-aeca2cfa6ebd None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.861653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2620-f61e-428b-b21a-aeca2cfa6ebd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.861653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2620-f61e-428b-b21a-aeca2cfa6ebd None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.864040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 695/1389] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:02.870091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fffbd-52c7-4346-b4ba-1db5ee1d170c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:02.870711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fffbd-52c7-4346-b4ba-1db5ee1d170c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:02.870711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fffbd-52c7-4346-b4ba-1db5ee1d170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:02.953460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fb4fffbd-52c7-4346-b4ba-1db5ee1d170c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:02.954760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fb4fffbd-52c7-4346-b4ba-1db5ee1d170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:03.078237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 695/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:37:03.356200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732557-d4f2-49e7-b3ab-dec360001187 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.356639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732557-d4f2-49e7-b3ab-dec360001187 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.357082 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732557-d4f2-49e7-b3ab-dec360001187 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.359714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 696/1391] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:37:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:03.367221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc1a0f-d47d-4c4c-81ae-932eb28ee277 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.367636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc1a0f-d47d-4c4c-81ae-932eb28ee277 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.368049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc1a0f-d47d-4c4c-81ae-932eb28ee277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.374414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1732557-d4f2-49e7-b3ab-dec360001187 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:03.376723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d1732557-d4f2-49e7-b3ab-dec360001187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:03.452584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1acc1a0f-d47d-4c4c-81ae-932eb28ee277 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:03.454069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1acc1a0f-d47d-4c4c-81ae-932eb28ee277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:03.477203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.497211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.556678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1732557-d4f2-49e7-b3ab-dec360001187 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:03.574732 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 696/1392] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:03.716547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32208a0-df98-41b4-959a-5cfc872d5187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:03.717084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32208a0-df98-41b4-959a-5cfc872d5187 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.717355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32208a0-df98-41b4-959a-5cfc872d5187 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.717645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32208a0-df98-41b4-959a-5cfc872d5187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.719409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f32208a0-df98-41b4-959a-5cfc872d5187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:03.802934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.839410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32208a0-df98-41b4-959a-5cfc872d5187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:03.841266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32208a0-df98-41b4-959a-5cfc872d5187 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:03.867571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 697/1393] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:37:03.884386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce8b1-3261-4664-8275-0779baac65a7 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.885413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce8b1-3261-4664-8275-0779baac65a7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.885608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce8b1-3261-4664-8275-0779baac65a7 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.887236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 697/1394] 10.222.0.49 () {54 vars in 967 bytes} [Tue Aug 30 14:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:37:03.894071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5f322-d7a9-43b0-8ce0-361a0c84e08b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:03.894445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5f322-d7a9-43b0-8ce0-361a0c84e08b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:03.894871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5f322-d7a9-43b0-8ce0-361a0c84e08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:03.990153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8bc5f322-d7a9-43b0-8ce0-361a0c84e08b None None] MFA Rules not processed for user `89357dc69c8f456580613061f2cbef07`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:03.991378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8bc5f322-d7a9-43b0-8ce0-361a0c84e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:04.087894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 698/1395] 10.222.0.49 () {58 vars in 1064 bytes} [Tue Aug 30 14:37:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:04.096081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ce8b1-3261-4664-8275-0779baac65a7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:04.097798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ec8ce8b1-3261-4664-8275-0779baac65a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:04.218114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ce8b1-3261-4664-8275-0779baac65a7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:04.274450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:04.303624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5bb1a-c793-4854-bcf8-1fbe306f70fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89357dc69c8f456580613061f2cbef07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:04.304245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5bb1a-c793-4854-bcf8-1fbe306f70fb service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:04.304553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5bb1a-c793-4854-bcf8-1fbe306f70fb service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:04.304777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5bb1a-c793-4854-bcf8-1fbe306f70fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:04.306411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d3f5bb1a-c793-4854-bcf8-1fbe306f70fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:04.449399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5bb1a-c793-4854-bcf8-1fbe306f70fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:04.450891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5bb1a-c793-4854-bcf8-1fbe306f70fb service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:04.473387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 698/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:37:05.335561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1729-511e-4ebe-a836-bf44196f67cf None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.336268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1729-511e-4ebe-a836-bf44196f67cf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.336268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a1729-511e-4ebe-a836-bf44196f67cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.436489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6e7a1729-511e-4ebe-a836-bf44196f67cf None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:05.438701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6e7a1729-511e-4ebe-a836-bf44196f67cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:05.443470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.561323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 699/1397] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:37:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:05.607988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803fcd9-aefd-4750-8970-ebc1be7bffec None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.608638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803fcd9-aefd-4750-8970-ebc1be7bffec None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.608638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803fcd9-aefd-4750-8970-ebc1be7bffec None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.610033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 699/1398] 10.222.0.49 () {54 vars in 943 bytes} [Tue Aug 30 14:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:05.617746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9dda-9cf9-42b8-acaa-aa2984f9ae13 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.618478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9dda-9cf9-42b8-acaa-aa2984f9ae13 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.618877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9dda-9cf9-42b8-acaa-aa2984f9ae13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.703201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d2cf9dda-9cf9-42b8-acaa-aa2984f9ae13 None None] MFA Rules not processed for user `b4639f179d4b4bb7b1fae6a8cf28d919`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:05.704450 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d2cf9dda-9cf9-42b8-acaa-aa2984f9ae13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:05.802713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.839103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 700/1399] 10.222.0.49 () {58 vars in 1040 bytes} [Tue Aug 30 14:37:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:05.849111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803fcd9-aefd-4750-8970-ebc1be7bffec None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:05.850674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6803fcd9-aefd-4750-8970-ebc1be7bffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:05.971677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:05.977520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e29f-8af4-4d79-9893-6a9b9d7d67b0 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.977826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e29f-8af4-4d79-9893-6a9b9d7d67b0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.978054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e29f-8af4-4d79-9893-6a9b9d7d67b0 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:05.979667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 701/1400] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:05.986178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd381d62-bb92-474f-84bb-4173fd29f6b0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:05.986562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd381d62-bb92-474f-84bb-4173fd29f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:05.986873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd381d62-bb92-474f-84bb-4173fd29f6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.048294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803fcd9-aefd-4750-8970-ebc1be7bffec None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:06.107825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bd381d62-bb92-474f-84bb-4173fd29f6b0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:06.110661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bd381d62-bb92-474f-84bb-4173fd29f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:06.177425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0e4d3-56ea-40b2-8a4d-70d20295e7ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:06.178238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e4d3-56ea-40b2-8a4d-70d20295e7ba service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:06.178726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e4d3-56ea-40b2-8a4d-70d20295e7ba service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:06.179191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e4d3-56ea-40b2-8a4d-70d20295e7ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:06.181366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-90e0e4d3-56ea-40b2-8a4d-70d20295e7ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:06.253705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 702/1401] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:37:06.261763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:06.290814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0e4d3-56ea-40b2-8a4d-70d20295e7ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:06.293797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0e4d3-56ea-40b2-8a4d-70d20295e7ba service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:06.309330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 700/1402] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:37:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:37:06.599662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd381d62-bb92-474f-84bb-4173fd29f6b0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:06.601728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bd381d62-bb92-474f-84bb-4173fd29f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:06.726528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:06.815992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd381d62-bb92-474f-84bb-4173fd29f6b0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:07.008224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803eead-723d-491b-8bc0-3528db00cf80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:07.008933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803eead-723d-491b-8bc0-3528db00cf80 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:07.009422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803eead-723d-491b-8bc0-3528db00cf80 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:07.009873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803eead-723d-491b-8bc0-3528db00cf80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:07.012719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e803eead-723d-491b-8bc0-3528db00cf80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:07.093146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.170155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803eead-723d-491b-8bc0-3528db00cf80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:07.172847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803eead-723d-491b-8bc0-3528db00cf80 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:07.208720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 703/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:09.276620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb242-db87-4431-95e8-a28321eb85dd None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.277257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb242-db87-4431-95e8-a28321eb85dd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.277356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb242-db87-4431-95e8-a28321eb85dd None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.279690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 701/1404] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:09.289595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349b09-e82e-4812-bffa-ff941afa77df None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:09.290186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349b09-e82e-4812-bffa-ff941afa77df None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:09.290574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8349b09-e82e-4812-bffa-ff941afa77df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:09.399733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c8349b09-e82e-4812-bffa-ff941afa77df None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:09.401081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c8349b09-e82e-4812-bffa-ff941afa77df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:09.546440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 704/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:09.842593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb242-db87-4431-95e8-a28321eb85dd None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:09.845028 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b13bb242-db87-4431-95e8-a28321eb85dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:10.080231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb242-db87-4431-95e8-a28321eb85dd None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:10.156551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:10.247801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47773c02-d178-4e2b-a938-8b9c3f92bdae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:10.248450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47773c02-d178-4e2b-a938-8b9c3f92bdae service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:10.248723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47773c02-d178-4e2b-a938-8b9c3f92bdae service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:10.248987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47773c02-d178-4e2b-a938-8b9c3f92bdae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:10.250660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-47773c02-d178-4e2b-a938-8b9c3f92bdae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:10.372182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47773c02-d178-4e2b-a938-8b9c3f92bdae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:10.373803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47773c02-d178-4e2b-a938-8b9c3f92bdae service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:10.406616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 702/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:12.708323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ea2e-8944-4381-a836-4e8d4157581a None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.709146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ea2e-8944-4381-a836-4e8d4157581a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.710615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ea2e-8944-4381-a836-4e8d4157581a None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.712352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 705/1407] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:37:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:12.719876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a57f0-793d-485b-94f0-c696b7b9fb3c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:12.720599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a57f0-793d-485b-94f0-c696b7b9fb3c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:12.720599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a57f0-793d-485b-94f0-c696b7b9fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:12.964953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-337a57f0-793d-485b-94f0-c696b7b9fb3c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:12.966117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-337a57f0-793d-485b-94f0-c696b7b9fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:12.992501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.122556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 703/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:13.439704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ea2e-8944-4381-a836-4e8d4157581a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:13.441527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e855ea2e-8944-4381-a836-4e8d4157581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:13.481492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.631893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ea2e-8944-4381-a836-4e8d4157581a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:13.761081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:13.776307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e10d7a-4cf7-4e8f-88ad-342752f1c604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:13.777346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10d7a-4cf7-4e8f-88ad-342752f1c604 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:13.777833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10d7a-4cf7-4e8f-88ad-342752f1c604 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:13.778578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10d7a-4cf7-4e8f-88ad-342752f1c604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:13.781727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-99e10d7a-4cf7-4e8f-88ad-342752f1c604 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:13.900818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e10d7a-4cf7-4e8f-88ad-342752f1c604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:13.902865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e10d7a-4cf7-4e8f-88ad-342752f1c604 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:13.935733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 706/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:23.119110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=37 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:23.933081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=50 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:29.428822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35a30-da06-4170-b716-3467a0dbb3ad None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.429414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35a30-da06-4170-b716-3467a0dbb3ad None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.429414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35a30-da06-4170-b716-3467a0dbb3ad None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.430966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 704/1410] 10.222.0.49 () {54 vars in 918 bytes} [Tue Aug 30 14:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:29.436534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e736a46-51d6-4693-a368-0b5433ce0300 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.437016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e736a46-51d6-4693-a368-0b5433ce0300 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.437108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e736a46-51d6-4693-a368-0b5433ce0300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.526397 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7e736a46-51d6-4693-a368-0b5433ce0300 None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:29.527666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7e736a46-51d6-4693-a368-0b5433ce0300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:29.650395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 707/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Aug 30 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:29.665889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f616b-3c5e-465b-bd82-b4015c7cb402 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.666106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f616b-3c5e-465b-bd82-b4015c7cb402 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.666349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f616b-3c5e-465b-bd82-b4015c7cb402 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.667711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 705/1412] 10.222.0.49 () {54 vars in 918 bytes} [Tue Aug 30 14:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:29.673034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302671eb-c20b-4a48-a08e-b889b3515440 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:29.673317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302671eb-c20b-4a48-a08e-b889b3515440 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:29.673582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302671eb-c20b-4a48-a08e-b889b3515440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:29.764865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:29.769925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-302671eb-c20b-4a48-a08e-b889b3515440 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:29.771604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-302671eb-c20b-4a48-a08e-b889b3515440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:29.919659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 708/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Aug 30 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:32.379359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bccd9-585b-45c7-95e9-9513f2fddfdf None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.380100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bccd9-585b-45c7-95e9-9513f2fddfdf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.380100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bccd9-585b-45c7-95e9-9513f2fddfdf None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.381262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:32.387576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f8385-e745-4e8e-b501-8c820dca9be4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:32.388168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f8385-e745-4e8e-b501-8c820dca9be4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:32.388168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f8385-e745-4e8e-b501-8c820dca9be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:32.496519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5a2f8385-e745-4e8e-b501-8c820dca9be4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:32.497751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5a2f8385-e745-4e8e-b501-8c820dca9be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:32.570946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:32.621172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:32.920397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bccd9-585b-45c7-95e9-9513f2fddfdf None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:32.922646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ad4bccd9-585b-45c7-95e9-9513f2fddfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:33.106152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bccd9-585b-45c7-95e9-9513f2fddfdf None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:33.184715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:33.232804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93757f-8057-4ce7-874e-95edf9c3de32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:33.233406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93757f-8057-4ce7-874e-95edf9c3de32 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:33.233696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93757f-8057-4ce7-874e-95edf9c3de32 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:33.233961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93757f-8057-4ce7-874e-95edf9c3de32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:33.235671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5e93757f-8057-4ce7-874e-95edf9c3de32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:33.335093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93757f-8057-4ce7-874e-95edf9c3de32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:33.336723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93757f-8057-4ce7-874e-95edf9c3de32 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:33.357389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 707/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:37:34.265991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211810-3c2a-4103-b229-b8da49cd126b None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.266824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211810-3c2a-4103-b229-b8da49cd126b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.266824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4211810-3c2a-4103-b229-b8da49cd126b None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.268040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:34.273604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2f1f-c04e-4b71-aa37-7c42fd625efb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.274365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2f1f-c04e-4b71-aa37-7c42fd625efb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.274572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2f1f-c04e-4b71-aa37-7c42fd625efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.356482 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-954d2f1f-c04e-4b71-aa37-7c42fd625efb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:34.357727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-954d2f1f-c04e-4b71-aa37-7c42fd625efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:34.388702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:34.467815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:34.620179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4211810-3c2a-4103-b229-b8da49cd126b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:34.621762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b4211810-3c2a-4103-b229-b8da49cd126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:34.797421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4211810-3c2a-4103-b229-b8da49cd126b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:34.844167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:34.926109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea694a-f651-45fb-baa1-aaedc991c3c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:34.926864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea694a-f651-45fb-baa1-aaedc991c3c1 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:34.927266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea694a-f651-45fb-baa1-aaedc991c3c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:34.927639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea694a-f651-45fb-baa1-aaedc991c3c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:34.929465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7eea694a-f651-45fb-baa1-aaedc991c3c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:35.027741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea694a-f651-45fb-baa1-aaedc991c3c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:35.029387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea694a-f651-45fb-baa1-aaedc991c3c1 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:35.050693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 711/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:35.982267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfe76-3a9b-4222-b999-fa00c1d5ba51 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.982846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfe76-3a9b-4222-b999-fa00c1d5ba51 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.982846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfe76-3a9b-4222-b999-fa00c1d5ba51 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:35.984166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:35.989975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc03f-8748-44ca-825c-7a82c25fec0f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:35.990526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc03f-8748-44ca-825c-7a82c25fec0f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:35.990526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc03f-8748-44ca-825c-7a82c25fec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.058508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.085621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-dc5cc03f-8748-44ca-825c-7a82c25fec0f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:36.086936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dc5cc03f-8748-44ca-825c-7a82c25fec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:36.194938 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:36.355295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccfe76-3a9b-4222-b999-fa00c1d5ba51 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:36.357711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-93ccfe76-3a9b-4222-b999-fa00c1d5ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:36.529675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccfe76-3a9b-4222-b999-fa00c1d5ba51 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:36.542968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:36.659017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579422c-2460-4fb4-bb35-a989c197186d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:36.659540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579422c-2460-4fb4-bb35-a989c197186d service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:36.659809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579422c-2460-4fb4-bb35-a989c197186d service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:36.660072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579422c-2460-4fb4-bb35-a989c197186d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:36.661704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1579422c-2460-4fb4-bb35-a989c197186d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:36.786163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579422c-2460-4fb4-bb35-a989c197186d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:36.788028 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579422c-2460-4fb4-bb35-a989c197186d service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:36.810012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 710/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:37.724902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7357-fef9-43ba-999e-5d357e0f4cc5 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.725592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7357-fef9-43ba-999e-5d357e0f4cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.725592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7357-fef9-43ba-999e-5d357e0f4cc5 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.726725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:37.732450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961709-4ad1-4ade-b4d8-409daac0df70 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:37.733037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961709-4ad1-4ade-b4d8-409daac0df70 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:37.733037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961709-4ad1-4ade-b4d8-409daac0df70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:37.764302 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:37.836207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-10961709-4ad1-4ade-b4d8-409daac0df70 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:37.837768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-10961709-4ad1-4ade-b4d8-409daac0df70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:37.947910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:38.102943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7357-fef9-43ba-999e-5d357e0f4cc5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:38.104504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2fed7357-fef9-43ba-999e-5d357e0f4cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:38.269588 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.312081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7357-fef9-43ba-999e-5d357e0f4cc5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:38.447541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739701c9-5949-4c98-a433-ff4607562349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:38.448161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739701c9-5949-4c98-a433-ff4607562349 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:38.448454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739701c9-5949-4c98-a433-ff4607562349 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:38.448706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739701c9-5949-4c98-a433-ff4607562349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:38.450343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-739701c9-5949-4c98-a433-ff4607562349 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:38.538269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.559119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739701c9-5949-4c98-a433-ff4607562349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:38.562262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739701c9-5949-4c98-a433-ff4607562349 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:38.594615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 714/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:39.476455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294176a9-dfc9-4eab-b625-9e4f200a464a None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.477070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294176a9-dfc9-4eab-b625-9e4f200a464a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.477070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294176a9-dfc9-4eab-b625-9e4f200a464a None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.478420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:39.484014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590c1e-f60e-44d4-a8c2-b649253c52c9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:39.484454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590c1e-f60e-44d4-a8c2-b649253c52c9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:39.484552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03590c1e-f60e-44d4-a8c2-b649253c52c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:39.569277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-03590c1e-f60e-44d4-a8c2-b649253c52c9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:39.570611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-03590c1e-f60e-44d4-a8c2-b649253c52c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:39.672709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:39.825191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294176a9-dfc9-4eab-b625-9e4f200a464a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:39.826786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-294176a9-dfc9-4eab-b625-9e4f200a464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:39.919641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:39.991206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294176a9-dfc9-4eab-b625-9e4f200a464a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:40.113406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d7b97-e8e6-4d3e-be97-f055307727af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:40.114016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7b97-e8e6-4d3e-be97-f055307727af service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:40.114283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7b97-e8e6-4d3e-be97-f055307727af service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:40.114573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7b97-e8e6-4d3e-be97-f055307727af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:40.116186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dc2d7b97-e8e6-4d3e-be97-f055307727af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:40.169475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:40.211620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d7b97-e8e6-4d3e-be97-f055307727af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:40.213214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d7b97-e8e6-4d3e-be97-f055307727af service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:40.231685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 713/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:41.091083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc45f-37f2-4105-8db8-6f4625007f87 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.091704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc45f-37f2-4105-8db8-6f4625007f87 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.091704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc45f-37f2-4105-8db8-6f4625007f87 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.093120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:41.099237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380ae03-aaeb-4a48-a8d1-94a8a514e684 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.099740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380ae03-aaeb-4a48-a8d1-94a8a514e684 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.099740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380ae03-aaeb-4a48-a8d1-94a8a514e684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.184757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1380ae03-aaeb-4a48-a8d1-94a8a514e684 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:41.185979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1380ae03-aaeb-4a48-a8d1-94a8a514e684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:41.293470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:41.474417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dc45f-37f2-4105-8db8-6f4625007f87 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:41.476102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-291dc45f-37f2-4105-8db8-6f4625007f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:41.529194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.642068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dc45f-37f2-4105-8db8-6f4625007f87 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:41.777170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125aea4-5fdb-433d-a91d-7a8f868edf0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:41.777660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125aea4-5fdb-433d-a91d-7a8f868edf0d service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:41.777938 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125aea4-5fdb-433d-a91d-7a8f868edf0d service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:41.778210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125aea4-5fdb-433d-a91d-7a8f868edf0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:41.779947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3125aea4-5fdb-433d-a91d-7a8f868edf0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:41.788523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:41.895236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125aea4-5fdb-433d-a91d-7a8f868edf0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:41.897090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125aea4-5fdb-433d-a91d-7a8f868edf0d service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:41.919691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 717/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:42.750838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fde0a-1075-4df6-a6cd-0aa1f9c9ebb2 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.751412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fde0a-1075-4df6-a6cd-0aa1f9c9ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.751412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fde0a-1075-4df6-a6cd-0aa1f9c9ebb2 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.752961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:42.759296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955443eb-7432-48a0-8f02-99c11c090518 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:42.759945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955443eb-7432-48a0-8f02-99c11c090518 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:42.759945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955443eb-7432-48a0-8f02-99c11c090518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:42.843756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-955443eb-7432-48a0-8f02-99c11c090518 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:42.844975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-955443eb-7432-48a0-8f02-99c11c090518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:42.926726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:42.962094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:43.119166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fde0a-1075-4df6-a6cd-0aa1f9c9ebb2 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:43.122089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d67fde0a-1075-4df6-a6cd-0aa1f9c9ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:43.154422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.322706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fde0a-1075-4df6-a6cd-0aa1f9c9ebb2 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:43.419890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:43.448919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3b6e8-6237-4ac6-9280-de22a556c5f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:43.449538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3b6e8-6237-4ac6-9280-de22a556c5f5 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:43.449814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3b6e8-6237-4ac6-9280-de22a556c5f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:43.450081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3b6e8-6237-4ac6-9280-de22a556c5f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:43.451745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fbb3b6e8-6237-4ac6-9280-de22a556c5f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:43.548086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3b6e8-6237-4ac6-9280-de22a556c5f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:43.549729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3b6e8-6237-4ac6-9280-de22a556c5f5 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:43.570168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 716/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:44.399324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c64d35-af43-4b89-8a5a-4e8569251ae5 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.400060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c64d35-af43-4b89-8a5a-4e8569251ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.400060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c64d35-af43-4b89-8a5a-4e8569251ae5 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.401485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:44.407378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc3293-0624-4847-9faa-10094131cc1e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:44.407968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc3293-0624-4847-9faa-10094131cc1e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:44.407968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc3293-0624-4847-9faa-10094131cc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:44.490893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-23fc3293-0624-4847-9faa-10094131cc1e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:44.492114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-23fc3293-0624-4847-9faa-10094131cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:44.534779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:44.599254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:44.762875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c64d35-af43-4b89-8a5a-4e8569251ae5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:44.764316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-41c64d35-af43-4b89-8a5a-4e8569251ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:44.937558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c64d35-af43-4b89-8a5a-4e8569251ae5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:45.019579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:45.103036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b14dc9-601e-4d19-b484-93708d99cd7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:45.103658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14dc9-601e-4d19-b484-93708d99cd7f service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:45.103921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14dc9-601e-4d19-b484-93708d99cd7f service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:45.104183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14dc9-601e-4d19-b484-93708d99cd7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:45.105786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b3b14dc9-601e-4d19-b484-93708d99cd7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:45.203751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b14dc9-601e-4d19-b484-93708d99cd7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:45.205408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b14dc9-601e-4d19-b484-93708d99cd7f service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:45.226965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 720/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:46.074249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dc61-b089-4455-850e-df6fa7bab76d None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.074873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dc61-b089-4455-850e-df6fa7bab76d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.074873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67dc61-b089-4455-850e-df6fa7bab76d None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.076261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:46.082809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02065c2d-3d37-4390-ba23-920a3cf3e840 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.083393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02065c2d-3d37-4390-ba23-920a3cf3e840 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.083515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02065c2d-3d37-4390-ba23-920a3cf3e840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.171544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-02065c2d-3d37-4390-ba23-920a3cf3e840 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:46.172774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-02065c2d-3d37-4390-ba23-920a3cf3e840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:46.175099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.279024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:46.428774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67dc61-b089-4455-850e-df6fa7bab76d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:46.430322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1c67dc61-b089-4455-850e-df6fa7bab76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:46.585992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67dc61-b089-4455-850e-df6fa7bab76d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:46.614976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:46.706855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b2b7d-7ecf-419b-af83-6472dad1a48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:46.707460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b2b7d-7ecf-419b-af83-6472dad1a48f service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:46.707720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b2b7d-7ecf-419b-af83-6472dad1a48f service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:46.707979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b2b7d-7ecf-419b-af83-6472dad1a48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:46.709578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-458b2b7d-7ecf-419b-af83-6472dad1a48f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:46.804776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b2b7d-7ecf-419b-af83-6472dad1a48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:46.806399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b2b7d-7ecf-419b-af83-6472dad1a48f service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:46.827804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 719/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:48.638005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ca330-f7d6-4f0a-865b-ff848789737f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.638556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ca330-f7d6-4f0a-865b-ff848789737f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.638556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ca330-f7d6-4f0a-865b-ff848789737f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.639989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:48.646266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fffcf-cbb3-4fe6-9585-5e21037d968e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:48.646913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fffcf-cbb3-4fe6-9585-5e21037d968e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:48.646913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fffcf-cbb3-4fe6-9585-5e21037d968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:48.690293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:48.725114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-128fffcf-cbb3-4fe6-9585-5e21037d968e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:48.726362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-128fffcf-cbb3-4fe6-9585-5e21037d968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:48.842183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:37:49.128311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ca330-f7d6-4f0a-865b-ff848789737f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:49.129936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-399ca330-f7d6-4f0a-865b-ff848789737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:49.262392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ca330-f7d6-4f0a-865b-ff848789737f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:49.298426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:49.345010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59bb67-48be-4fd8-b182-ecb66ebe3227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:49.345724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59bb67-48be-4fd8-b182-ecb66ebe3227 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:49.346169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59bb67-48be-4fd8-b182-ecb66ebe3227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:49.346636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59bb67-48be-4fd8-b182-ecb66ebe3227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:49.348740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eb59bb67-48be-4fd8-b182-ecb66ebe3227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:49.480655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59bb67-48be-4fd8-b182-ecb66ebe3227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:49.482099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59bb67-48be-4fd8-b182-ecb66ebe3227 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:49.503985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 723/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:51.665668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763a91-af0c-4b3c-893a-e67a8f619726 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.666213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763a91-af0c-4b3c-893a-e67a8f619726 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.666213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1763a91-af0c-4b3c-893a-e67a8f619726 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.667572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:51.673111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e34afb-c7cc-4346-87fb-5145a54061a7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:51.673619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e34afb-c7cc-4346-87fb-5145a54061a7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:51.674031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e34afb-c7cc-4346-87fb-5145a54061a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:51.743578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d6e34afb-c7cc-4346-87fb-5145a54061a7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:51.744811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d6e34afb-c7cc-4346-87fb-5145a54061a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:51.757969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:51.846306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:52.126733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1763a91-af0c-4b3c-893a-e67a8f619726 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:52.128304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d1763a91-af0c-4b3c-893a-e67a8f619726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:52.239558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1763a91-af0c-4b3c-893a-e67a8f619726 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:52.252558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:52.319528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96c15d-1370-4db1-b325-868aa19a3978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:52.320144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c15d-1370-4db1-b325-868aa19a3978 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:52.320420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c15d-1370-4db1-b325-868aa19a3978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:52.320694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c15d-1370-4db1-b325-868aa19a3978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:52.322322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cf96c15d-1370-4db1-b325-868aa19a3978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:52.442719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96c15d-1370-4db1-b325-868aa19a3978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:52.444156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96c15d-1370-4db1-b325-868aa19a3978 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:52.463646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 722/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:54.733791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baedb89-7a49-48bf-b2cd-eac62352da7c None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.734352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baedb89-7a49-48bf-b2cd-eac62352da7c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.734352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baedb89-7a49-48bf-b2cd-eac62352da7c None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.735588 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:54.741841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5f8d-1c76-4650-a26d-e27aa0011e33 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:54.742465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5f8d-1c76-4650-a26d-e27aa0011e33 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:54.742465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5f8d-1c76-4650-a26d-e27aa0011e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:54.798419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:54.827038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-68ce5f8d-1c76-4650-a26d-e27aa0011e33 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:54.828264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-68ce5f8d-1c76-4650-a26d-e27aa0011e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:54.944972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:55.241302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baedb89-7a49-48bf-b2cd-eac62352da7c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:55.242861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2baedb89-7a49-48bf-b2cd-eac62352da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:55.353483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baedb89-7a49-48bf-b2cd-eac62352da7c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:55.398292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:55.437855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd8d1a-2d40-4db6-bddb-6412462b6e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:55.438538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd8d1a-2d40-4db6-bddb-6412462b6e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:55.438809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd8d1a-2d40-4db6-bddb-6412462b6e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:55.439105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd8d1a-2d40-4db6-bddb-6412462b6e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:55.441105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a7dd8d1a-2d40-4db6-bddb-6412462b6e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:55.566843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd8d1a-2d40-4db6-bddb-6412462b6e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:55.568352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd8d1a-2d40-4db6-bddb-6412462b6e30 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:55.588650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 726/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:57.624424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293b7f-f2ec-4b46-a302-3bcc486716f4 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.625032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293b7f-f2ec-4b46-a302-3bcc486716f4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.625032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293b7f-f2ec-4b46-a302-3bcc486716f4 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.626314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:37:57.632246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3d91-fdc3-4ba2-b46a-2cd3ebc1aba0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:57.632709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3d91-fdc3-4ba2-b46a-2cd3ebc1aba0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:57.632709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3d91-fdc3-4ba2-b46a-2cd3ebc1aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:57.704156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-cfbe3d91-fdc3-4ba2-b46a-2cd3ebc1aba0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:37:57.705443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cfbe3d91-fdc3-4ba2-b46a-2cd3ebc1aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:57.727318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.807150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:37:58.091957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8293b7f-f2ec-4b46-a302-3bcc486716f4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:37:58.093492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d8293b7f-f2ec-4b46-a302-3bcc486716f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:58.211068 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8293b7f-f2ec-4b46-a302-3bcc486716f4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:37:58.232582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:58.299095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1629e-6853-48c1-a66d-b758cb00d37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:37:58.299710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1629e-6853-48c1-a66d-b758cb00d37f service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:37:58.299986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1629e-6853-48c1-a66d-b758cb00d37f service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:37:58.300283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1629e-6853-48c1-a66d-b758cb00d37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:37:58.302088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-25a1629e-6853-48c1-a66d-b758cb00d37f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:37:58.431960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1629e-6853-48c1-a66d-b758cb00d37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:37:58.433392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1629e-6853-48c1-a66d-b758cb00d37f service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:37:58.453901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 725/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:00.447152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635f6cd-9626-4948-b740-972697043b7e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.447714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635f6cd-9626-4948-b740-972697043b7e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.447843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635f6cd-9626-4948-b740-972697043b7e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.449303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:00.455115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643796a-0beb-43ab-8cff-5d817e05899d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:00.455662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643796a-0beb-43ab-8cff-5d817e05899d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:00.455777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643796a-0beb-43ab-8cff-5d817e05899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:00.527522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:00.531404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2643796a-0beb-43ab-8cff-5d817e05899d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:00.533876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2643796a-0beb-43ab-8cff-5d817e05899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:00.646604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:00.932772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635f6cd-9626-4948-b740-972697043b7e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:00.934673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f635f6cd-9626-4948-b740-972697043b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:01.046291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635f6cd-9626-4948-b740-972697043b7e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:01.099605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:01.126522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd85a46-60fd-4903-954b-e9b73e65397f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:01.127212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd85a46-60fd-4903-954b-e9b73e65397f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:01.127557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd85a46-60fd-4903-954b-e9b73e65397f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:01.127829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd85a46-60fd-4903-954b-e9b73e65397f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:01.129455 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ffd85a46-60fd-4903-954b-e9b73e65397f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:01.245134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd85a46-60fd-4903-954b-e9b73e65397f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:01.246530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd85a46-60fd-4903-954b-e9b73e65397f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:01.265251 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 729/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:03.252267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d06c6-dc30-4165-8576-717c6f433204 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.252841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d06c6-dc30-4165-8576-717c6f433204 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.252841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d06c6-dc30-4165-8576-717c6f433204 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.254228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:03.260849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041d6c-aea5-4d9d-b6ed-44d8816127f8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.261538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041d6c-aea5-4d9d-b6ed-44d8816127f8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.261656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041d6c-aea5-4d9d-b6ed-44d8816127f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.335966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-88041d6c-aea5-4d9d-b6ed-44d8816127f8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:03.337119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-88041d6c-aea5-4d9d-b6ed-44d8816127f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:03.369359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.449766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:38:03.739087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d06c6-dc30-4165-8576-717c6f433204 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:03.740771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4f5d06c6-dc30-4165-8576-717c6f433204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:03.856295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d06c6-dc30-4165-8576-717c6f433204 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:03.892309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:03.946213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f46e87-4ee0-4913-beea-57510b69ddb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:03.946875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46e87-4ee0-4913-beea-57510b69ddb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:03.947149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46e87-4ee0-4913-beea-57510b69ddb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:03.947420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f46e87-4ee0-4913-beea-57510b69ddb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:03.949033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-11f46e87-4ee0-4913-beea-57510b69ddb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:04.066151 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f46e87-4ee0-4913-beea-57510b69ddb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:04.067640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f46e87-4ee0-4913-beea-57510b69ddb8 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:04.087925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 728/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:06.070495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298cae-6477-40e6-b4d6-4a469d4690f4 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.071117 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298cae-6477-40e6-b4d6-4a469d4690f4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.071117 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298cae-6477-40e6-b4d6-4a469d4690f4 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.072558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:06.078120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2371-bfd3-480f-bf30-63dca6324aab None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.078618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2371-bfd3-480f-bf30-63dca6324aab None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.078703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2371-bfd3-480f-bf30-63dca6324aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.149962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-16de2371-bfd3-480f-bf30-63dca6324aab None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:06.151233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-16de2371-bfd3-480f-bf30-63dca6324aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:06.160195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.256158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:06.538062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31298cae-6477-40e6-b4d6-4a469d4690f4 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:06.539653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-31298cae-6477-40e6-b4d6-4a469d4690f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:06.659625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31298cae-6477-40e6-b4d6-4a469d4690f4 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:06.719926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:06.739708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6e042-cff0-4827-b5b6-77add04af0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:06.740327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6e042-cff0-4827-b5b6-77add04af0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:06.740927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6e042-cff0-4827-b5b6-77add04af0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:06.741206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6e042-cff0-4827-b5b6-77add04af0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:06.742867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-60c6e042-cff0-4827-b5b6-77add04af0f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:06.870096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6e042-cff0-4827-b5b6-77add04af0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:06.871818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6e042-cff0-4827-b5b6-77add04af0f4 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:06.892395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 732/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:08.912442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3ae4-6766-4f3f-93e4-f6729cba8d09 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.913135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3ae4-6766-4f3f-93e4-f6729cba8d09 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.913135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3ae4-6766-4f3f-93e4-f6729cba8d09 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.914355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:08.919872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4c20-b21d-4469-8d3b-90458b263744 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:08.920376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4c20-b21d-4469-8d3b-90458b263744 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:08.920376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4c20-b21d-4469-8d3b-90458b263744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:08.993765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4cad4c20-b21d-4469-8d3b-90458b263744 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:08.995066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4cad4c20-b21d-4469-8d3b-90458b263744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:09.037693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.099679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:09.398411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3ae4-6766-4f3f-93e4-f6729cba8d09 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:09.399991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bdcb3ae4-6766-4f3f-93e4-f6729cba8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:09.521533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3ae4-6766-4f3f-93e4-f6729cba8d09 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:09.562288 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:09.604035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198cf0f-98a3-4886-ac31-bade7f66ac5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:09.604678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198cf0f-98a3-4886-ac31-bade7f66ac5d service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:09.604949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198cf0f-98a3-4886-ac31-bade7f66ac5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:09.605205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198cf0f-98a3-4886-ac31-bade7f66ac5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:09.606901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5198cf0f-98a3-4886-ac31-bade7f66ac5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:09.723468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198cf0f-98a3-4886-ac31-bade7f66ac5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:09.724835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198cf0f-98a3-4886-ac31-bade7f66ac5d service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:09.744279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 731/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:11.688261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d036-6696-4453-a1a7-3b5ead252b23 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.688856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d036-6696-4453-a1a7-3b5ead252b23 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.688856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d036-6696-4453-a1a7-3b5ead252b23 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.690159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:11.696504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0682b-4c58-47e6-a29e-6558ec8957d1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:11.697046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0682b-4c58-47e6-a29e-6558ec8957d1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:11.697046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0682b-4c58-47e6-a29e-6558ec8957d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:11.773764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-39d0682b-4c58-47e6-a29e-6558ec8957d1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:11.775034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-39d0682b-4c58-47e6-a29e-6558ec8957d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:11.793552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:11.876044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:12.157273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948d036-6696-4453-a1a7-3b5ead252b23 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:12.159217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b948d036-6696-4453-a1a7-3b5ead252b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:12.272498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948d036-6696-4453-a1a7-3b5ead252b23 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:12.341730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:12.350891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f40794-6441-42d7-8d87-ded9a7c05b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:12.351703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40794-6441-42d7-8d87-ded9a7c05b03 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:12.351984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40794-6441-42d7-8d87-ded9a7c05b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:12.352252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40794-6441-42d7-8d87-ded9a7c05b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:12.353864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-35f40794-6441-42d7-8d87-ded9a7c05b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:12.474575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f40794-6441-42d7-8d87-ded9a7c05b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:12.476046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f40794-6441-42d7-8d87-ded9a7c05b03 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:12.495264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 735/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:14.457644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fcb31-c8b1-42fb-ad32-4c3cf15f6b8c None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.458283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fcb31-c8b1-42fb-ad32-4c3cf15f6b8c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.458283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fcb31-c8b1-42fb-ad32-4c3cf15f6b8c None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.459567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:14.465377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768ad6-6385-4bbb-a6fc-f1c913d79ca7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:14.465871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768ad6-6385-4bbb-a6fc-f1c913d79ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:14.465871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768ad6-6385-4bbb-a6fc-f1c913d79ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:14.536193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c0768ad6-6385-4bbb-a6fc-f1c913d79ca7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:14.537420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c0768ad6-6385-4bbb-a6fc-f1c913d79ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:14.588004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:14.639044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:14.918299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fcb31-c8b1-42fb-ad32-4c3cf15f6b8c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:14.920186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dd3fcb31-c8b1-42fb-ad32-4c3cf15f6b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:15.058144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fcb31-c8b1-42fb-ad32-4c3cf15f6b8c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:15.127477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:15.156437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2f1a5-e676-4a19-b57e-d7d0e44dd109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:15.157049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f1a5-e676-4a19-b57e-d7d0e44dd109 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:15.157329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f1a5-e676-4a19-b57e-d7d0e44dd109 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:15.157597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2f1a5-e676-4a19-b57e-d7d0e44dd109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:15.159798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-92f2f1a5-e676-4a19-b57e-d7d0e44dd109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:15.275157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2f1a5-e676-4a19-b57e-d7d0e44dd109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:15.276514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2f1a5-e676-4a19-b57e-d7d0e44dd109 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:15.297045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 734/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:24.637043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=22 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:25.294411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=66 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:34.954984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3045551-0cdf-43c7-9e1a-b2c8b48e2716 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:34.955494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3045551-0cdf-43c7-9e1a-b2c8b48e2716 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:34.955867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3045551-0cdf-43c7-9e1a-b2c8b48e2716 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:34.957754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 737/1471] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:34.963613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1531d2-45ed-4030-a0a6-074c95f8ec07 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:34.964101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1531d2-45ed-4030-a0a6-074c95f8ec07 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:34.964226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1531d2-45ed-4030-a0a6-074c95f8ec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.036152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fd1531d2-45ed-4030-a0a6-074c95f8ec07 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:35.037390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fd1531d2-45ed-4030-a0a6-074c95f8ec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:35.137682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 735/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:35.434359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a13cd-4f8f-49a8-a9c2-47bf12e00c8f None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.434675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a13cd-4f8f-49a8-a9c2-47bf12e00c8f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.434979 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a13cd-4f8f-49a8-a9c2-47bf12e00c8f None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.436364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 738/1473] 10.222.0.49 () {54 vars in 967 bytes} [Tue Aug 30 14:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:35.442322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72541c6-30d0-49fc-8cdb-7c6d801ad452 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.442642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72541c6-30d0-49fc-8cdb-7c6d801ad452 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.442939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72541c6-30d0-49fc-8cdb-7c6d801ad452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.523573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a72541c6-30d0-49fc-8cdb-7c6d801ad452 None None] MFA Rules not processed for user `89357dc69c8f456580613061f2cbef07`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:35.524783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a72541c6-30d0-49fc-8cdb-7c6d801ad452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:35.546661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:35.607076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 736/1474] 10.222.0.49 () {58 vars in 1064 bytes} [Tue Aug 30 14:38:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:35.615754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a13cd-4f8f-49a8-a9c2-47bf12e00c8f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:35.618101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4d7a13cd-4f8f-49a8-a9c2-47bf12e00c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:35.741335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a13cd-4f8f-49a8-a9c2-47bf12e00c8f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:35.821190 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af60ed2-c360-4e8b-bc4b-9efe57d271a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89357dc69c8f456580613061f2cbef07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:35.821806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60ed2-c360-4e8b-bc4b-9efe57d271a7 service glance] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:35.822077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60ed2-c360-4e8b-bc4b-9efe57d271a7 service glance] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:35.822336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60ed2-c360-4e8b-bc4b-9efe57d271a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:35.824021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6af60ed2-c360-4e8b-bc4b-9efe57d271a7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:35.891433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:35.968197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af60ed2-c360-4e8b-bc4b-9efe57d271a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:35.969685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af60ed2-c360-4e8b-bc4b-9efe57d271a7 service glance] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:35.992784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 739/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:38.006624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de658d-df70-482a-a582-62197833ba22 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.007016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de658d-df70-482a-a582-62197833ba22 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.007016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de658d-df70-482a-a582-62197833ba22 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.008417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 737/1476] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:38.014100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c051-ff49-47fc-8959-7c2a8ea1cfc0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.014583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c051-ff49-47fc-8959-7c2a8ea1cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.014697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c051-ff49-47fc-8959-7c2a8ea1cfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.082621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fb15c051-ff49-47fc-8959-7c2a8ea1cfc0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:38.084051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fb15c051-ff49-47fc-8959-7c2a8ea1cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:38.189011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 740/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:38:38.463855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de658d-df70-482a-a582-62197833ba22 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:38.465415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f3de658d-df70-482a-a582-62197833ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:38.602815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de658d-df70-482a-a582-62197833ba22 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:38.662395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:38.717054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca27b9-3b0b-4d7f-9612-97a3f095dcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:38.717601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca27b9-3b0b-4d7f-9612-97a3f095dcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:38.717846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca27b9-3b0b-4d7f-9612-97a3f095dcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:38.718102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca27b9-3b0b-4d7f-9612-97a3f095dcd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:38.718800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca27b9-3b0b-4d7f-9612-97a3f095dcd0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:38.720723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-65ca27b9-3b0b-4d7f-9612-97a3f095dcd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:38:38.720723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: warnings.warn(msg) Aug 30 14:38:38.720723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: Aug 30 14:38:38.721792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca27b9-3b0b-4d7f-9612-97a3f095dcd0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:38.745281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 738/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Aug 30 14:38:38 2022] GET /identity/v3/projects => generated 2553 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:38:40.697922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe522ff-29b8-44e5-8967-6968d3df9eeb None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.698545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe522ff-29b8-44e5-8967-6968d3df9eeb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.698545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe522ff-29b8-44e5-8967-6968d3df9eeb None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.699752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 741/1479] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:40.706077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ef42-83ad-46d2-abb6-9ccfc7676266 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:40.706578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ef42-83ad-46d2-abb6-9ccfc7676266 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:40.706680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ef42-83ad-46d2-abb6-9ccfc7676266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:40.777267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-cbb1ef42-83ad-46d2-abb6-9ccfc7676266 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:40.778543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cbb1ef42-83ad-46d2-abb6-9ccfc7676266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:40.880078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 739/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:41.170112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe522ff-29b8-44e5-8967-6968d3df9eeb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:41.171909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cbe522ff-29b8-44e5-8967-6968d3df9eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:41.182390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:41.329027 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe522ff-29b8-44e5-8967-6968d3df9eeb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:41.418516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:41.465951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527d55f-7957-43e1-a0c5-36f69898a574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:41.466895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527d55f-7957-43e1-a0c5-36f69898a574 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:41.467303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527d55f-7957-43e1-a0c5-36f69898a574 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:41.467709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527d55f-7957-43e1-a0c5-36f69898a574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:41.470219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9527d55f-7957-43e1-a0c5-36f69898a574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:41.582220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527d55f-7957-43e1-a0c5-36f69898a574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:41.583910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527d55f-7957-43e1-a0c5-36f69898a574 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:41.604771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 742/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:43.758662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c36f0-cd40-4db1-834a-1ab20b03e2a6 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.759222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c36f0-cd40-4db1-834a-1ab20b03e2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.759222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c36f0-cd40-4db1-834a-1ab20b03e2a6 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.760458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 740/1482] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:43.766582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0dbfb-0f5a-42f3-9334-b8420cfa14f3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:43.767076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0dbfb-0f5a-42f3-9334-b8420cfa14f3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:43.767262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0dbfb-0f5a-42f3-9334-b8420cfa14f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:43.843828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-25d0dbfb-0f5a-42f3-9334-b8420cfa14f3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:43.845084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-25d0dbfb-0f5a-42f3-9334-b8420cfa14f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:43.896921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:43.953636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 743/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:44.234749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c36f0-cd40-4db1-834a-1ab20b03e2a6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:44.236337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fc4c36f0-cd40-4db1-834a-1ab20b03e2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:44.262326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.347456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c36f0-cd40-4db1-834a-1ab20b03e2a6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:44.427349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fc939-6142-47ee-b160-6ac1cdb78c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:44.427970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc939-6142-47ee-b160-6ac1cdb78c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:44.428249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc939-6142-47ee-b160-6ac1cdb78c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:44.428516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fc939-6142-47ee-b160-6ac1cdb78c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:44.430217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-519fc939-6142-47ee-b160-6ac1cdb78c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:44.510208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:44.547555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fc939-6142-47ee-b160-6ac1cdb78c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:44.549460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fc939-6142-47ee-b160-6ac1cdb78c38 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:44.569092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 741/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:46.518279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dafb72-abec-4b85-acc9-c43d52c7bb3b None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:46.518904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dafb72-abec-4b85-acc9-c43d52c7bb3b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:46.518904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dafb72-abec-4b85-acc9-c43d52c7bb3b None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:46.520272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 744/1485] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:46.526118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e217-5eb7-4f0b-a36e-ee48dcf6c3da None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:46.526574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e217-5eb7-4f0b-a36e-ee48dcf6c3da None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:46.526697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e217-5eb7-4f0b-a36e-ee48dcf6c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:46.609364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-dea8e217-5eb7-4f0b-a36e-ee48dcf6c3da None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:46.610631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dea8e217-5eb7-4f0b-a36e-ee48dcf6c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:46.735173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 742/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:47.016584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dafb72-abec-4b85-acc9-c43d52c7bb3b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:47.018595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b2dafb72-abec-4b85-acc9-c43d52c7bb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:47.128574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dafb72-abec-4b85-acc9-c43d52c7bb3b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:47.206929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:47.209343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f3dc-4c44-4c77-ac87-1d222a97a95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:47.211288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f3dc-4c44-4c77-ac87-1d222a97a95f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:47.211288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f3dc-4c44-4c77-ac87-1d222a97a95f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:47.211288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f3dc-4c44-4c77-ac87-1d222a97a95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:47.212920 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8e97f3dc-4c44-4c77-ac87-1d222a97a95f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:47.346629 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f3dc-4c44-4c77-ac87-1d222a97a95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:47.348084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f3dc-4c44-4c77-ac87-1d222a97a95f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:47.369360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 745/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:49.380527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73ebe-47f7-4b58-8db6-2282d05702f0 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.381118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73ebe-47f7-4b58-8db6-2282d05702f0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.381118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73ebe-47f7-4b58-8db6-2282d05702f0 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.382582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 743/1488] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:49.388203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6398c2-2f7e-4ddc-b3ee-b227dc35f9fc None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:49.388607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6398c2-2f7e-4ddc-b3ee-b227dc35f9fc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:49.388782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6398c2-2f7e-4ddc-b3ee-b227dc35f9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:49.461074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3c6398c2-2f7e-4ddc-b3ee-b227dc35f9fc None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:49.462292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3c6398c2-2f7e-4ddc-b3ee-b227dc35f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:49.518233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:49.564199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 746/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:38:49.859637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73ebe-47f7-4b58-8db6-2282d05702f0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:49.861857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8ab73ebe-47f7-4b58-8db6-2282d05702f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:49.900145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:49.977126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73ebe-47f7-4b58-8db6-2282d05702f0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:50.052436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92191ef3-6199-4561-b291-30c846dfbe85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:50.053086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92191ef3-6199-4561-b291-30c846dfbe85 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:50.053361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92191ef3-6199-4561-b291-30c846dfbe85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:50.053627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92191ef3-6199-4561-b291-30c846dfbe85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:50.055257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-92191ef3-6199-4561-b291-30c846dfbe85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:50.138324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:50.169618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92191ef3-6199-4561-b291-30c846dfbe85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:50.171104 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92191ef3-6199-4561-b291-30c846dfbe85 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:50.191280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 744/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:52.290537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce73b6-d861-4c91-8a1a-776e91616aa2 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:52.291126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce73b6-d861-4c91-8a1a-776e91616aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:52.291126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce73b6-d861-4c91-8a1a-776e91616aa2 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:52.292433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 747/1491] 10.222.0.49 () {54 vars in 927 bytes} [Tue Aug 30 14:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:38:52.297922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319b90-7554-4b66-93d3-5b4b9afa2ccd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:52.298416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319b90-7554-4b66-93d3-5b4b9afa2ccd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:52.298539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59319b90-7554-4b66-93d3-5b4b9afa2ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:52.369269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-59319b90-7554-4b66-93d3-5b4b9afa2ccd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:38:52.370525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-59319b90-7554-4b66-93d3-5b4b9afa2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:52.481521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 745/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Tue Aug 30 14:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:38:52.767654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce73b6-d861-4c91-8a1a-776e91616aa2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:38:52.769273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-56ce73b6-d861-4c91-8a1a-776e91616aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:52.881391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce73b6-d861-4c91-8a1a-776e91616aa2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:38:52.962846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256b41-c187-4d4a-acaf-79ea8ffd1833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:38:52.963544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256b41-c187-4d4a-acaf-79ea8ffd1833 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:38:52.963818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256b41-c187-4d4a-acaf-79ea8ffd1833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:38:52.964097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256b41-c187-4d4a-acaf-79ea8ffd1833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:38:52.965753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-79256b41-c187-4d4a-acaf-79ea8ffd1833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:38:52.975598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:38:53.080923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79256b41-c187-4d4a-acaf-79ea8ffd1833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:38:53.082400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79256b41-c187-4d4a-acaf-79ea8ffd1833 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:38:53.102129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 748/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:39:02.479632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=82 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:03.099488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=50 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:06.970417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541b39-f562-471d-838e-940df9c6d4f6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:06.971148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541b39-f562-471d-838e-940df9c6d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:06.971148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541b39-f562-471d-838e-940df9c6d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:07.053958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5c541b39-f562-471d-838e-940df9c6d4f6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:07.055332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5c541b39-f562-471d-838e-940df9c6d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:07.158860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 746/1494] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:40:07.168291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83008-04ce-4d70-86e2-ad900384be74 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:07.169173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83008-04ce-4d70-86e2-ad900384be74 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:07.169371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83008-04ce-4d70-86e2-ad900384be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:07.254443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-84e83008-04ce-4d70-86e2-ad900384be74 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:07.255705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-84e83008-04ce-4d70-86e2-ad900384be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:07.362106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 749/1495] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:40:07.367183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c541b39-f562-471d-838e-940df9c6d4f6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:07.368544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5c541b39-f562-471d-838e-940df9c6d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:07.380440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c541b39-f562-471d-838e-940df9c6d4f6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:07.452503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:07.489961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:07.490612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:07.490912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:07.491181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:07.491827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:40:07.492129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:07.493214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:40:07.493214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: warnings.warn(msg) Aug 30 14:40:07.493214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: Aug 30 14:40:07.494128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:07.508319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 747/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:40:07.516879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83008-04ce-4d70-86e2-ad900384be74 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:07.526653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83008-04ce-4d70-86e2-ad900384be74 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:07.591336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:07.626166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:07.626730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:07.627015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:07.627278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:07.627906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:07.629722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:40:07.629722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: warnings.warn(msg) Aug 30 14:40:07.629722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: Aug 30 14:40:07.630966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:07.690001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 750/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:40:07 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:40:07.694517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:07.696063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:07.731452 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196ca08-241c-4f38-86c4-b7f42da3e463 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:07.832181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:07.832793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:07.833067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:07.833334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:07.833959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:07.835001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:40:07.835001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: warnings.warn(msg) Aug 30 14:40:07.835001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: Aug 30 14:40:07.836226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:07.881922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 748/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:40:07 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:40:07.886416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:07.887995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:07.956793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdcf5d-ac88-4061-a2f7-aab1f15d9410 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:08.051454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:08.064446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:08.065084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:08.065361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:08.065634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:08.066285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:08.067396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:40:08.067396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: warnings.warn(msg) Aug 30 14:40:08.067396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: Aug 30 14:40:08.068282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:08.081740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 751/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:40:08.086067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:08.087669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:08.099471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7967b7-ceec-4981-b834-441138829c82 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:08.125618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:08.201764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a1967-6e2a-4842-b011-0b8c5b4461a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:08.202414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a1967-6e2a-4842-b011-0b8c5b4461a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:08.203283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a1967-6e2a-4842-b011-0b8c5b4461a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:08.203562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a1967-6e2a-4842-b011-0b8c5b4461a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:08.204218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a1967-6e2a-4842-b011-0b8c5b4461a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:08.205247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-4c6a1967-6e2a-4842-b011-0b8c5b4461a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:40:08.205247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: warnings.warn(msg) Aug 30 14:40:08.205247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: Aug 30 14:40:08.206131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a1967-6e2a-4842-b011-0b8c5b4461a3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:08.219509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 749/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:40:08.224133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:08.226052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:08.264720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16b7e-345d-4f97-9707-0a83adf637d4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:08.370097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fba29-2c0c-4b94-986c-e4448fb95d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:08.370814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fba29-2c0c-4b94-986c-e4448fb95d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:08.371098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fba29-2c0c-4b94-986c-e4448fb95d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:08.371369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fba29-2c0c-4b94-986c-e4448fb95d37 admin admin] PATH_INFO: `/v3/projects/d2990d7201e945dd92bce07d87f9145a/users/9c0b0a2624ed46608c1fb898c4785516/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:08.395637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fba29-2c0c-4b94-986c-e4448fb95d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2990d7201e945dd92bce07d87f9145a, user_id=9c0b0a2624ed46608c1fb898c4785516, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:08.396694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-e97fba29-2c0c-4b94-986c-e4448fb95d37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:40:08.396694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: warnings.warn(msg) Aug 30 14:40:08.396694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: Aug 30 14:40:08.398670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fba29-2c0c-4b94-986c-e4448fb95d37 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:08.427959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 752/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:40:08 2022] PUT /identity/v3/projects/d2990d7201e945dd92bce07d87f9145a/users/9c0b0a2624ed46608c1fb898c4785516/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:40:08.441622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110f4a2-b9e2-4954-bc41-f167ed17f32a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:08.441902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110f4a2-b9e2-4954-bc41-f167ed17f32a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:08.442173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110f4a2-b9e2-4954-bc41-f167ed17f32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:08.500854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e110f4a2-b9e2-4954-bc41-f167ed17f32a None None] MFA Rules not processed for user `9c0b0a2624ed46608c1fb898c4785516`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:08.502085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e110f4a2-b9e2-4954-bc41-f167ed17f32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:08.583504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 750/1502] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:40:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:40:08.598662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e98f8-9cfe-4f79-a5e8-82da812d407e None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:08.598945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e98f8-9cfe-4f79-a5e8-82da812d407e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:08.599217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e98f8-9cfe-4f79-a5e8-82da812d407e None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:08.600602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 753/1503] 10.222.0.49 () {54 vars in 964 bytes} [Tue Aug 30 14:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:08.605851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290dcd-fe03-4a62-8398-3a4fd711baf2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:08.606148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290dcd-fe03-4a62-8398-3a4fd711baf2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:08.606471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68290dcd-fe03-4a62-8398-3a4fd711baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:08.645677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:08.696529 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-68290dcd-fe03-4a62-8398-3a4fd711baf2 None None] MFA Rules not processed for user `a725ee4d8b0b4524ad8484c3255f75da`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:08.697773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-68290dcd-fe03-4a62-8398-3a4fd711baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:08.777932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 751/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Tue Aug 30 14:40:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:40:08.786556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e98f8-9cfe-4f79-a5e8-82da812d407e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:08.788099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8c8e98f8-9cfe-4f79-a5e8-82da812d407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:08.841125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:08.897785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e98f8-9cfe-4f79-a5e8-82da812d407e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:08.986449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:08.986982 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:08.987256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:08.987517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:08.989141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:09.097662 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:09.099160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:09.102676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:09.118358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 754/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:40:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:40:09.164387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fd314-f269-4a0b-9869-5e3ee10ee397 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:09.164870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fd314-f269-4a0b-9869-5e3ee10ee397 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:09.164992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fd314-f269-4a0b-9869-5e3ee10ee397 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:09.166197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 752/1506] 10.222.0.49 () {52 vars in 830 bytes} [Tue Aug 30 14:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:40:09.170169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:09.171454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:09.275551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3ecc7-2a3a-4350-a245-ce023ae928f8 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:09.381934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:09.382669 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:09.382951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:09.383221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] PATH_INFO: `/v3/users/9c0b0a2624ed46608c1fb898c4785516` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:09.398417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0b0a2624ed46608c1fb898c4785516)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:09.400180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:40:09.400180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: warnings.warn(msg) Aug 30 14:40:09.400180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: Aug 30 14:40:09.401434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:09.413766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:09.475474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0b0a2624ed46608c1fb898c4785516'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:09.500677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0b0a2624ed46608c1fb898c4785516'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:09.519442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0b0a2624ed46608c1fb898c4785516'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:09.519988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0b0a2624ed46608c1fb898c4785516'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:09.520478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0b0a2624ed46608c1fb898c4785516'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:09.537096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 755/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:40:09 2022] DELETE /identity/v3/users/9c0b0a2624ed46608c1fb898c4785516 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:40:09.542119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30449-b8c6-4ed8-80b1-7e2ae82b6445 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:09.542431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30449-b8c6-4ed8-80b1-7e2ae82b6445 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:09.542707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30449-b8c6-4ed8-80b1-7e2ae82b6445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:09.606913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-26c30449-b8c6-4ed8-80b1-7e2ae82b6445 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:40:09.608152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-26c30449-b8c6-4ed8-80b1-7e2ae82b6445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:09.685795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:09.700413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 753/1508] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:40:09.711000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:09.712297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:09.820246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3aa0-7259-426e-bf54-c3efad8e49af admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:09.878430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:09.902576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69cd3f-5422-45df-8a4f-b40f68e10743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:09.903215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69cd3f-5422-45df-8a4f-b40f68e10743 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:09.903491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69cd3f-5422-45df-8a4f-b40f68e10743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:09.903755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69cd3f-5422-45df-8a4f-b40f68e10743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:09.905410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0b69cd3f-5422-45df-8a4f-b40f68e10743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:10.026489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69cd3f-5422-45df-8a4f-b40f68e10743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:10.027958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69cd3f-5422-45df-8a4f-b40f68e10743 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:10.057695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 756/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:40:10.411546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c30449-b8c6-4ed8-80b1-7e2ae82b6445 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:40:10.412085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-26c30449-b8c6-4ed8-80b1-7e2ae82b6445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:40:10.424284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c30449-b8c6-4ed8-80b1-7e2ae82b6445 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:40:10.532689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:40:10.533326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:40:10.533593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:40:10.533853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] PATH_INFO: `/v3/projects/d2990d7201e945dd92bce07d87f9145a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:40:10.545291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2990d7201e945dd92bce07d87f9145a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:40:10.546339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:40:10.546339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: warnings.warn(msg) Aug 30 14:40:10.546339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: Aug 30 14:40:10.548008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:40:10.610921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2990d7201e945dd92bce07d87f9145a', 'request_id': 'req-ef6b72d7-c56e-44c4-8a34-59b0835faa29'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:10.625998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2990d7201e945dd92bce07d87f9145a', 'request_id': 'req-ef6b72d7-c56e-44c4-8a34-59b0835faa29'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:10.633632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2990d7201e945dd92bce07d87f9145a', 'request_id': 'req-ef6b72d7-c56e-44c4-8a34-59b0835faa29'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:10.664124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] The token cache is being invalidate because project d2990d7201e945dd92bce07d87f9145a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:40:10.664360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:10.664838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ef6b72d7-c56e-44c4-8a34-59b0835faa29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:40:10.666210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 754/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:40:10 2022] DELETE /identity/v3/projects/d2990d7201e945dd92bce07d87f9145a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:40:20.053315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=62 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:20.661722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:48.892053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a263a22-738b-41bc-97a6-8c9402fd8d09 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:48.892701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a263a22-738b-41bc-97a6-8c9402fd8d09 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:48.892701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a263a22-738b-41bc-97a6-8c9402fd8d09 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:48.893954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:48.903365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb1681-3e13-4d01-805c-1ab440303cc3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:48.903960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb1681-3e13-4d01-805c-1ab440303cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:48.903960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb1681-3e13-4d01-805c-1ab440303cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:49.009218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-04fb1681-3e13-4d01-805c-1ab440303cc3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:49.010418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-04fb1681-3e13-4d01-805c-1ab440303cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:49.123695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:41:49.284462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a263a22-738b-41bc-97a6-8c9402fd8d09 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:49.286681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4a263a22-738b-41bc-97a6-8c9402fd8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:49.421345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a263a22-738b-41bc-97a6-8c9402fd8d09 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:49.427573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8a78-6f8f-434a-8c03-0a814b5f7e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:49.428188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8a78-6f8f-434a-8c03-0a814b5f7e6a service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:49.428467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8a78-6f8f-434a-8c03-0a814b5f7e6a service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:49.428729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8a78-6f8f-434a-8c03-0a814b5f7e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:49.438218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8a78-6f8f-434a-8c03-0a814b5f7e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:49.439888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8a78-6f8f-434a-8c03-0a814b5f7e6a service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:49.449673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 758/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:41:50.300305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b199-665e-417b-afeb-bcf7cd81172f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:50.301164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b199-665e-417b-afeb-bcf7cd81172f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:50.301164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8b199-665e-417b-afeb-bcf7cd81172f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:50.302974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:41:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:50.309538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd725b2-46d3-4a1e-a78c-bb6e15f453a2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:50.310358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd725b2-46d3-4a1e-a78c-bb6e15f453a2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:50.310554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd725b2-46d3-4a1e-a78c-bb6e15f453a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:50.336901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7dd725b2-46d3-4a1e-a78c-bb6e15f453a2 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:50.338153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7dd725b2-46d3-4a1e-a78c-bb6e15f453a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:50.347568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:41:50.502237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8b199-665e-417b-afeb-bcf7cd81172f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:50.517497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8b199-665e-417b-afeb-bcf7cd81172f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:50.523293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea520-166a-4451-ac5e-9210dbc845c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:50.523933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea520-166a-4451-ac5e-9210dbc845c5 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:50.524217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea520-166a-4451-ac5e-9210dbc845c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:50.524493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea520-166a-4451-ac5e-9210dbc845c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:50.532951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ea520-166a-4451-ac5e-9210dbc845c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:50.534614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ea520-166a-4451-ac5e-9210dbc845c5 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:50.544166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 757/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:41:51.112259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04203102-d092-4d3a-a2e4-1ff4dada5999 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:51.112538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04203102-d092-4d3a-a2e4-1ff4dada5999 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:51.112858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04203102-d092-4d3a-a2e4-1ff4dada5999 None None] PATH_INFO: `/v3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:51.114840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 760/1517] 10.222.0.44 () {54 vars in 925 bytes} [Tue Aug 30 14:41:51 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:41:51.122093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283446a-8631-449c-8612-6d6eef62e063 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:51.122395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283446a-8631-449c-8612-6d6eef62e063 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:51.122670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283446a-8631-449c-8612-6d6eef62e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:51.190043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1283446a-8631-449c-8612-6d6eef62e063 None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:51.191312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1283446a-8631-449c-8612-6d6eef62e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:51.209175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:41:51.268638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 758/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Aug 30 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:41:55.164046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81718fd6-f466-4a02-bdf9-7c700bf943e3 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:55.164905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81718fd6-f466-4a02-bdf9-7c700bf943e3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:55.164905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81718fd6-f466-4a02-bdf9-7c700bf943e3 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:55.166884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 761/1519] 10.222.0.49 () {54 vars in 961 bytes} [Tue Aug 30 14:41:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:41:55.175691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667735e-30dd-4753-8e49-a2aaa867c9c1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:55.176476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667735e-30dd-4753-8e49-a2aaa867c9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:55.176628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667735e-30dd-4753-8e49-a2aaa867c9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:55.206814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d667735e-30dd-4753-8e49-a2aaa867c9c1 None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:41:55.208610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d667735e-30dd-4753-8e49-a2aaa867c9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:41:55.221120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 759/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Aug 30 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:41:55.229679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81718fd6-f466-4a02-bdf9-7c700bf943e3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:41:55.251376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81718fd6-f466-4a02-bdf9-7c700bf943e3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:41:55.257575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae46eb5-5d96-41af-81d5-3eac2b7f32af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:41:55.258182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46eb5-5d96-41af-81d5-3eac2b7f32af service placement] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:41:55.258476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46eb5-5d96-41af-81d5-3eac2b7f32af service placement] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:41:55.258754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46eb5-5d96-41af-81d5-3eac2b7f32af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:41:55.268275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae46eb5-5d96-41af-81d5-3eac2b7f32af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:41:55.269872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae46eb5-5d96-41af-81d5-3eac2b7f32af service placement] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:41:55.280441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 762/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:42:01.811963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582059-0298-4c86-9e13-3f1f6a18b4d6 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:01.813060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582059-0298-4c86-9e13-3f1f6a18b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:01.813060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582059-0298-4c86-9e13-3f1f6a18b4d6 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:01.814874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:42:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:42:01.820328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39e39-4fc0-4d69-b7ee-8ccc6aebbbf9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:01.820816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39e39-4fc0-4d69-b7ee-8ccc6aebbbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:01.820916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f39e39-4fc0-4d69-b7ee-8ccc6aebbbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:01.847498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-15f39e39-4fc0-4d69-b7ee-8ccc6aebbbf9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:42:01.848726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-15f39e39-4fc0-4d69-b7ee-8ccc6aebbbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:01.858409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:42:02.021886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7582059-0298-4c86-9e13-3f1f6a18b4d6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:42:02.037437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7582059-0298-4c86-9e13-3f1f6a18b4d6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:42:02.044822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e2ec-8c87-4111-9d90-b8845a4323ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:42:02.045498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e2ec-8c87-4111-9d90-b8845a4323ee service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:02.045776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e2ec-8c87-4111-9d90-b8845a4323ee service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:02.046073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e2ec-8c87-4111-9d90-b8845a4323ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:02.055645 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687e2ec-8c87-4111-9d90-b8845a4323ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:42:02.057265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687e2ec-8c87-4111-9d90-b8845a4323ee service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:42:02.073914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 761/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:42:02.908042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ba9b-03fd-4716-977c-fa7b71d85d8d None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:02.908681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ba9b-03fd-4716-977c-fa7b71d85d8d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:02.908681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ba9b-03fd-4716-977c-fa7b71d85d8d None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:02.909930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 14:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:42:02.915045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961887-f0c2-4f21-a62a-40a5d3a9e140 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:02.915456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961887-f0c2-4f21-a62a-40a5d3a9e140 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:02.915549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961887-f0c2-4f21-a62a-40a5d3a9e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:02.935886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9b961887-f0c2-4f21-a62a-40a5d3a9e140 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:42:02.937087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9b961887-f0c2-4f21-a62a-40a5d3a9e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:02.945561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:42:03.100770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814ba9b-03fd-4716-977c-fa7b71d85d8d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:42:03.118981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814ba9b-03fd-4716-977c-fa7b71d85d8d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:42:03.126309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a5d4-c4cb-4aa7-8489-4380e80e30fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:42:03.127260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a5d4-c4cb-4aa7-8489-4380e80e30fa service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:03.127663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a5d4-c4cb-4aa7-8489-4380e80e30fa service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:03.128058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a5d4-c4cb-4aa7-8489-4380e80e30fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:03.140076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16a5d4-c4cb-4aa7-8489-4380e80e30fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:42:03.141743 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16a5d4-c4cb-4aa7-8489-4380e80e30fa service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:42:03.152692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 765/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:42:06.917361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47307eb-1327-4b5c-887a-539f48cc2165 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:06.918340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47307eb-1327-4b5c-887a-539f48cc2165 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:06.918340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47307eb-1327-4b5c-887a-539f48cc2165 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:06.920133 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:42:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:42:06.925812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60380a-cb0b-49f8-be71-b47ff732b72c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:06.926299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60380a-cb0b-49f8-be71-b47ff732b72c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:06.926299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60380a-cb0b-49f8-be71-b47ff732b72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:06.947637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2f60380a-cb0b-49f8-be71-b47ff732b72c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:42:06.948840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2f60380a-cb0b-49f8-be71-b47ff732b72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:06.958203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:42:07.262394 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47307eb-1327-4b5c-887a-539f48cc2165 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:42:07.264965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e47307eb-1327-4b5c-887a-539f48cc2165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:07.361747 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47307eb-1327-4b5c-887a-539f48cc2165 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:42:07.365590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fde920-a40f-4bf0-aaeb-6cdb1340d58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:42:07.366206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde920-a40f-4bf0-aaeb-6cdb1340d58d service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:07.366595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde920-a40f-4bf0-aaeb-6cdb1340d58d service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:07.366871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde920-a40f-4bf0-aaeb-6cdb1340d58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:07.376670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fde920-a40f-4bf0-aaeb-6cdb1340d58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:42:07.378177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fde920-a40f-4bf0-aaeb-6cdb1340d58d service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:42:07.388450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 764/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:42:09.285734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e0ce-6b6c-42bb-8a2e-853684d84ed1 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:09.286363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e0ce-6b6c-42bb-8a2e-853684d84ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:09.286363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e0ce-6b6c-42bb-8a2e-853684d84ed1 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:09.287641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:42:09.293296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776bb72-fc25-48c1-bbc3-40f50afea42e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:09.293838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776bb72-fc25-48c1-bbc3-40f50afea42e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:09.293838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776bb72-fc25-48c1-bbc3-40f50afea42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:09.315810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1776bb72-fc25-48c1-bbc3-40f50afea42e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:42:09.317044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1776bb72-fc25-48c1-bbc3-40f50afea42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:09.327244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:42:09.619106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93e0ce-6b6c-42bb-8a2e-853684d84ed1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:42:09.639126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93e0ce-6b6c-42bb-8a2e-853684d84ed1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:42:09.643562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ce5d4-4e04-452e-9d26-5c454d65c763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:42:09.644175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ce5d4-4e04-452e-9d26-5c454d65c763 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:09.644450 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ce5d4-4e04-452e-9d26-5c454d65c763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:09.644714 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ce5d4-4e04-452e-9d26-5c454d65c763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:09.654521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ce5d4-4e04-452e-9d26-5c454d65c763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:42:09.655981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ce5d4-4e04-452e-9d26-5c454d65c763 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:42:09.666108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 768/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:42:13.206704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020c52a-1884-4a9a-8a3d-9cfe40ae21df None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:13.207280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020c52a-1884-4a9a-8a3d-9cfe40ae21df None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:13.207280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020c52a-1884-4a9a-8a3d-9cfe40ae21df None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:13.208606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:42:13.214852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2115c77-fa14-43e9-aeda-a3534d8dd8f2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:13.215533 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2115c77-fa14-43e9-aeda-a3534d8dd8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:13.215758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2115c77-fa14-43e9-aeda-a3534d8dd8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:13.224638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=81 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:13.239166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b2115c77-fa14-43e9-aeda-a3534d8dd8f2 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:42:13.240401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b2115c77-fa14-43e9-aeda-a3534d8dd8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:13.249284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:42:13.806142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020c52a-1884-4a9a-8a3d-9cfe40ae21df None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:42:13.807943 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8020c52a-1884-4a9a-8a3d-9cfe40ae21df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:13.878200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:13.892930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020c52a-1884-4a9a-8a3d-9cfe40ae21df None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:42:13.896664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018b567-eb3e-4fce-a5e8-4682cbe2ddda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:42:13.897295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b567-eb3e-4fce-a5e8-4682cbe2ddda service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:13.897564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b567-eb3e-4fce-a5e8-4682cbe2ddda service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:13.897832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b567-eb3e-4fce-a5e8-4682cbe2ddda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:13.907650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018b567-eb3e-4fce-a5e8-4682cbe2ddda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:42:13.909095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018b567-eb3e-4fce-a5e8-4682cbe2ddda service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:42:13.919207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 767/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:42:15.877897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9601e-b5eb-483e-b62c-bc6a79a5dfbe None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:15.878908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9601e-b5eb-483e-b62c-bc6a79a5dfbe None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:15.878908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9601e-b5eb-483e-b62c-bc6a79a5dfbe None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:15.881134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 14:42:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:42:15.889983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891d31-6d48-4ce7-9435-8313b4e195bc None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:15.890619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891d31-6d48-4ce7-9435-8313b4e195bc None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:15.890831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5891d31-6d48-4ce7-9435-8313b4e195bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:15.912514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c5891d31-6d48-4ce7-9435-8313b4e195bc None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:42:15.913738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c5891d31-6d48-4ce7-9435-8313b4e195bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:15.922520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:42:16.485528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9601e-b5eb-483e-b62c-bc6a79a5dfbe None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:42:16.487745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a1d9601e-b5eb-483e-b62c-bc6a79a5dfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:42:16.503574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9601e-b5eb-483e-b62c-bc6a79a5dfbe None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:42:16.509409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9e52c-ba97-4aa7-9351-5f0c25558382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:42:16.510363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9e52c-ba97-4aa7-9351-5f0c25558382 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:42:16.510906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9e52c-ba97-4aa7-9351-5f0c25558382 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:42:16.511335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9e52c-ba97-4aa7-9351-5f0c25558382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:42:16.523046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9e52c-ba97-4aa7-9351-5f0c25558382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:42:16.524924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9e52c-ba97-4aa7-9351-5f0c25558382 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:42:16.534900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 771/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:42:25.906846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=11 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:26.530562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:44.550810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366873b-69d7-4bbb-887e-6400c4adc44d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.551528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366873b-69d7-4bbb-887e-6400c4adc44d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.551528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366873b-69d7-4bbb-887e-6400c4adc44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.583561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1366873b-69d7-4bbb-887e-6400c4adc44d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:44.584865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1366873b-69d7-4bbb-887e-6400c4adc44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:44.594218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 769/1540] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:43:44.604216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbd84-b30b-43b8-90d7-54a22ab318bb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.605608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbd84-b30b-43b8-90d7-54a22ab318bb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.606183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfbd84-b30b-43b8-90d7-54a22ab318bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.644367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3ebfbd84-b30b-43b8-90d7-54a22ab318bb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:44.646062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3ebfbd84-b30b-43b8-90d7-54a22ab318bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:44.658447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 772/1541] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:44.663325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366873b-69d7-4bbb-887e-6400c4adc44d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:44.677417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366873b-69d7-4bbb-887e-6400c4adc44d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:44.686663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f68fb-07c7-433f-ad62-3f4e8d4bd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:44.687299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f68fb-07c7-433f-ad62-3f4e8d4bd356 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.687575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f68fb-07c7-433f-ad62-3f4e8d4bd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.687845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f68fb-07c7-433f-ad62-3f4e8d4bd356 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.688505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f68fb-07c7-433f-ad62-3f4e8d4bd356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:44.688804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f68fb-07c7-433f-ad62-3f4e8d4bd356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:44.690445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f68fb-07c7-433f-ad62-3f4e8d4bd356 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:44.707050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 770/1542] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:44.716499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfbd84-b30b-43b8-90d7-54a22ab318bb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:44.732543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfbd84-b30b-43b8-90d7-54a22ab318bb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:44.743265 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c79ff-a550-4619-bf41-d5b47fa92f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:44.744317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c79ff-a550-4619-bf41-d5b47fa92f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.744843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c79ff-a550-4619-bf41-d5b47fa92f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.745642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c79ff-a550-4619-bf41-d5b47fa92f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.746563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c79ff-a550-4619-bf41-d5b47fa92f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:44.748810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c79ff-a550-4619-bf41-d5b47fa92f00 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:44.777349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21e01-d1b9-42ec-bd3c-3264e0ab8e2d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.777726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21e01-d1b9-42ec-bd3c-3264e0ab8e2d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.777919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21e01-d1b9-42ec-bd3c-3264e0ab8e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.812716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-89b21e01-d1b9-42ec-bd3c-3264e0ab8e2d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:44.813953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-89b21e01-d1b9-42ec-bd3c-3264e0ab8e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:44.819122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 773/1543] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:43:44.820925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6412a31-33cb-4cbd-8de3-75a3835b66ce None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.821535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6412a31-33cb-4cbd-8de3-75a3835b66ce None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.822070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6412a31-33cb-4cbd-8de3-75a3835b66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.855629 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f6412a31-33cb-4cbd-8de3-75a3835b66ce None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:44.857475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f6412a31-33cb-4cbd-8de3-75a3835b66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:44.905643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 771/1544] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:44.906456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21e01-d1b9-42ec-bd3c-3264e0ab8e2d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:44.923454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21e01-d1b9-42ec-bd3c-3264e0ab8e2d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:44.930552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b414810-1b22-43f1-ae13-d0454e7cb749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:44.931431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b414810-1b22-43f1-ae13-d0454e7cb749 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.932158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b414810-1b22-43f1-ae13-d0454e7cb749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.932575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b414810-1b22-43f1-ae13-d0454e7cb749 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.933669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b414810-1b22-43f1-ae13-d0454e7cb749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:44.936094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b414810-1b22-43f1-ae13-d0454e7cb749 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:44.936236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 774/1545] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:44.942401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b36c9-643e-4441-a5a6-30b8c02c936d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.942401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b36c9-643e-4441-a5a6-30b8c02c936d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.942401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b36c9-643e-4441-a5a6-30b8c02c936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.959184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-330b36c9-643e-4441-a5a6-30b8c02c936d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:44.960382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-330b36c9-643e-4441-a5a6-30b8c02c936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:44.960664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 772/1546] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:44.962156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededab0f-2f86-4c53-bbc1-c19756409365 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.962494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededab0f-2f86-4c53-bbc1-c19756409365 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.962786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededab0f-2f86-4c53-bbc1-c19756409365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.971383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 775/1547] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:44.972529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66e4c-a593-49ee-98aa-21513676b1a5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.972884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66e4c-a593-49ee-98aa-21513676b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.973284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66e4c-a593-49ee-98aa-21513676b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:44.984729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ededab0f-2f86-4c53-bbc1-c19756409365 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:44.985956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ededab0f-2f86-4c53-bbc1-c19756409365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:44.994032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 773/1548] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:44.995487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a5af-4878-4aec-82c6-77402284ad4e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:44.995773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a5af-4878-4aec-82c6-77402284ad4e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:44.996043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3a5af-4878-4aec-82c6-77402284ad4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.017377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b3b3a5af-4878-4aec-82c6-77402284ad4e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.018668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b3b3a5af-4878-4aec-82c6-77402284ad4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.027271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 774/1549] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.028633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975e29-6ae8-4271-9641-50825cffd77b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.028901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975e29-6ae8-4271-9641-50825cffd77b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.029191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975e29-6ae8-4271-9641-50825cffd77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.051545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-40975e29-6ae8-4271-9641-50825cffd77b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.052797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-40975e29-6ae8-4271-9641-50825cffd77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.061744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 775/1550] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.063151 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b39e6c-f3c9-41c2-87dc-c6e16cc4a149 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.063377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b39e6c-f3c9-41c2-87dc-c6e16cc4a149 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.063646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b39e6c-f3c9-41c2-87dc-c6e16cc4a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.088002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-45b39e6c-f3c9-41c2-87dc-c6e16cc4a149 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.089270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-45b39e6c-f3c9-41c2-87dc-c6e16cc4a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.097840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 776/1551] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.099167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee6b8-ad37-45c6-baf3-34727f32ecce None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.099447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee6b8-ad37-45c6-baf3-34727f32ecce None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.099715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee6b8-ad37-45c6-baf3-34727f32ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.119898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-188ee6b8-ad37-45c6-baf3-34727f32ecce None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.120676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5ed66e4c-a593-49ee-98aa-21513676b1a5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.121110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-188ee6b8-ad37-45c6-baf3-34727f32ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.121846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5ed66e4c-a593-49ee-98aa-21513676b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.129628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 777/1552] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.130560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ee6b8-ad37-45c6-baf3-34727f32ecce None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.134621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 776/1553] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.136022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071112e-a079-4642-b655-f28ab7c26491 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.136309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071112e-a079-4642-b655-f28ab7c26491 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.136539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071112e-a079-4642-b655-f28ab7c26491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.141328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ee6b8-ad37-45c6-baf3-34727f32ecce None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.145965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6b75-2a16-45da-accd-8e047a079201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.146614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6b75-2a16-45da-accd-8e047a079201 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.146894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6b75-2a16-45da-accd-8e047a079201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.147173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6b75-2a16-45da-accd-8e047a079201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.147833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a6b75-2a16-45da-accd-8e047a079201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.149663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a6b75-2a16-45da-accd-8e047a079201 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.156037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0071112e-a079-4642-b655-f28ab7c26491 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.157236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0071112e-a079-4642-b655-f28ab7c26491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.160521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 778/1554] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:45.161792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db01d9-31a3-417f-825a-bbaadfcd4ab9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.162075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db01d9-31a3-417f-825a-bbaadfcd4ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.162347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db01d9-31a3-417f-825a-bbaadfcd4ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.165289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 777/1555] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.166084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071112e-a079-4642-b655-f28ab7c26491 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.175532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071112e-a079-4642-b655-f28ab7c26491 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.180320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3b623-d82f-4494-a728-e5ce823b0583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.180958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b623-d82f-4494-a728-e5ce823b0583 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.181226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b623-d82f-4494-a728-e5ce823b0583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.181491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b623-d82f-4494-a728-e5ce823b0583 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.182501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3b623-d82f-4494-a728-e5ce823b0583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:45.182794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3b623-d82f-4494-a728-e5ce823b0583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.183400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e3db01d9-31a3-417f-825a-bbaadfcd4ab9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.183822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-bcb3b623-d82f-4494-a728-e5ce823b0583 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:43:45.183822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: warnings.warn(msg) Aug 30 14:43:45.183822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: Aug 30 14:43:45.184687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e3db01d9-31a3-417f-825a-bbaadfcd4ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.184804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3b623-d82f-4494-a728-e5ce823b0583 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.196847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 779/1556] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.196847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682e743-3511-410b-b706-72d00b8e5e33 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.196847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682e743-3511-410b-b706-72d00b8e5e33 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.196847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682e743-3511-410b-b706-72d00b8e5e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.197972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 778/1557] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:45.198965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcba6f-d4a5-45b6-9e06-2eb7f3d269bf None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.199294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcba6f-d4a5-45b6-9e06-2eb7f3d269bf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.199533 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcba6f-d4a5-45b6-9e06-2eb7f3d269bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.217857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2682e743-3511-410b-b706-72d00b8e5e33 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.219149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2682e743-3511-410b-b706-72d00b8e5e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.219263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-25fcba6f-d4a5-45b6-9e06-2eb7f3d269bf None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.220341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-25fcba6f-d4a5-45b6-9e06-2eb7f3d269bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.227074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 780/1558] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.228202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682e743-3511-410b-b706-72d00b8e5e33 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.229385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.234459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634d04-c938-4ffa-924b-8fba8058ccc5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.234743 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634d04-c938-4ffa-924b-8fba8058ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.235012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634d04-c938-4ffa-924b-8fba8058ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.238084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682e743-3511-410b-b706-72d00b8e5e33 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.242722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.243391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.243669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.243936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.244585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:45.244882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.246526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.256010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-98634d04-c938-4ffa-924b-8fba8058ccc5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.257241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-98634d04-c938-4ffa-924b-8fba8058ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.258361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 781/1560] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:45.259310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.268283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 780/1561] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:45.269257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634d04-c938-4ffa-924b-8fba8058ccc5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.275555 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848a69-28de-49a7-9bac-ce476532f6d4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.279816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634d04-c938-4ffa-924b-8fba8058ccc5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.280633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000be54-117b-427d-a96a-5666578a8089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.281242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000be54-117b-427d-a96a-5666578a8089 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.281515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000be54-117b-427d-a96a-5666578a8089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.281779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000be54-117b-427d-a96a-5666578a8089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.282438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000be54-117b-427d-a96a-5666578a8089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.284036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000be54-117b-427d-a96a-5666578a8089 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.285943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.286735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.287017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.287289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.287934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:45.288232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.290048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.295415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 782/1562] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:45.296392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000be54-117b-427d-a96a-5666578a8089 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.304383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 781/1563] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:45.305331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.314149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000be54-117b-427d-a96a-5666578a8089 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.316083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8e7fa-d885-4a9a-bc12-41796b766885 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.318992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.319608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.319879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.320127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.320766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:45.320890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ed02b-6ba2-4fa7-8214-48dd44276261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.321153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.321532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ed02b-6ba2-4fa7-8214-48dd44276261 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.321810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ed02b-6ba2-4fa7-8214-48dd44276261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.322067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ed02b-6ba2-4fa7-8214-48dd44276261 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.322737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ed02b-6ba2-4fa7-8214-48dd44276261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.323109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.324636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ed02b-6ba2-4fa7-8214-48dd44276261 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.335730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 783/1564] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:45.336508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.348176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573efb8-7459-454d-be9d-9ed99e4c28b9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.354027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.354695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.354971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.355244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.355879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:45.356175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.357782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.364827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 782/1565] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.364827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ed02b-6ba2-4fa7-8214-48dd44276261 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.371123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 784/1566] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:45.371965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.381746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85cc46-4aa6-4a47-a9d3-907a6b96ae57 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.395333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:45.418726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:45.439164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ed02b-6ba2-4fa7-8214-48dd44276261 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.443997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.444618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.444889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.445155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.445828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:45.446238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.447998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.448306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.448921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.449191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.449458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.450120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.451171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:43:45.451171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: warnings.warn(msg) Aug 30 14:43:45.451171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: Aug 30 14:43:45.452351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.460335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 783/1567] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:45.461177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.471071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30770-82a7-4411-b15e-22a9c8e9c6d9 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.476014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.476817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.477143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.477495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.478343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:45.478667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.480298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.487002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 785/1568] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.487998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.503730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 784/1569] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:45.503730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.508840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3dcbc-e991-4b40-9d10-cf65a89c6b26 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.560594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce80cc0-eb66-4bf0-97b8-fb57eab85d75 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.565509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.566192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.566495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.566766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] PATH_INFO: `/v3/projects/86eca317ac0a44a49a48f81119ee2485/users/192a22cb876f4f72b09d5835b479f58c/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.567978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c37a54-ddb9-430f-b97c-9728402433f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.568592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37a54-ddb9-430f-b97c-9728402433f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.568880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37a54-ddb9-430f-b97c-9728402433f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.569146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37a54-ddb9-430f-b97c-9728402433f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.569779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c37a54-ddb9-430f-b97c-9728402433f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.575923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c37a54-ddb9-430f-b97c-9728402433f8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.582692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86eca317ac0a44a49a48f81119ee2485, user_id=192a22cb876f4f72b09d5835b479f58c, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.583729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:43:45.583729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: warnings.warn(msg) Aug 30 14:43:45.583729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: Aug 30 14:43:45.585631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.600444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 786/1570] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:45 2022] PUT /identity/v3/projects/86eca317ac0a44a49a48f81119ee2485/users/192a22cb876f4f72b09d5835b479f58c/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:45.603976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 785/1571] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.604134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.604223 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c37a54-ddb9-430f-b97c-9728402433f8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.667483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bfcbd-82e5-4c6f-a123-19c85688978d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.671487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c37a54-ddb9-430f-b97c-9728402433f8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.672659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27800c-effb-4cd2-a7fd-2d70f11dbeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.673337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27800c-effb-4cd2-a7fd-2d70f11dbeea admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.673615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27800c-effb-4cd2-a7fd-2d70f11dbeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.673911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27800c-effb-4cd2-a7fd-2d70f11dbeea admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.674777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27800c-effb-4cd2-a7fd-2d70f11dbeea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.676649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27800c-effb-4cd2-a7fd-2d70f11dbeea admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.676976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.677602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.677880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.678151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.678829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.679855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:43:45.679855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: warnings.warn(msg) Aug 30 14:43:45.679855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: Aug 30 14:43:45.681130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.706641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 786/1572] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.706641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.706962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 787/1573] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.707680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27800c-effb-4cd2-a7fd-2d70f11dbeea admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.718299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:45.719287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9ce30-bc17-4daf-86f7-1bfe31873137 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.756426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:45.776626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27800c-effb-4cd2-a7fd-2d70f11dbeea admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.781379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa57814-3900-46ce-8754-fb4836eb3c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.782004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa57814-3900-46ce-8754-fb4836eb3c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.782290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa57814-3900-46ce-8754-fb4836eb3c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.782592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa57814-3900-46ce-8754-fb4836eb3c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.782907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb7bad-2f41-4952-9ba2-4bb8092862cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.783236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa57814-3900-46ce-8754-fb4836eb3c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.783525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb7bad-2f41-4952-9ba2-4bb8092862cf admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.783805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb7bad-2f41-4952-9ba2-4bb8092862cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.784067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb7bad-2f41-4952-9ba2-4bb8092862cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.784693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb7bad-2f41-4952-9ba2-4bb8092862cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.785165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa57814-3900-46ce-8754-fb4836eb3c62 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.786693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb7bad-2f41-4952-9ba2-4bb8092862cf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.816147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 787/1574] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.816360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 788/1575] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.817144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa57814-3900-46ce-8754-fb4836eb3c62 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.819850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb7bad-2f41-4952-9ba2-4bb8092862cf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.887700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb7bad-2f41-4952-9ba2-4bb8092862cf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.892980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc2c3-bceb-4348-9c9b-ed6ca9e5ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.893602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc2c3-bceb-4348-9c9b-ed6ca9e5ff1d admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.893876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc2c3-bceb-4348-9c9b-ed6ca9e5ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.894135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfc2c3-bceb-4348-9c9b-ed6ca9e5ff1d admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.894478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa57814-3900-46ce-8754-fb4836eb3c62 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.894803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfc2c3-bceb-4348-9c9b-ed6ca9e5ff1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.896760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfc2c3-bceb-4348-9c9b-ed6ca9e5ff1d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.899748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea4f41-bab7-4d2c-8328-3b6a2f35a4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.900381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea4f41-bab7-4d2c-8328-3b6a2f35a4ad admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.900665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea4f41-bab7-4d2c-8328-3b6a2f35a4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.900959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea4f41-bab7-4d2c-8328-3b6a2f35a4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.901597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea4f41-bab7-4d2c-8328-3b6a2f35a4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.903568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea4f41-bab7-4d2c-8328-3b6a2f35a4ad admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.922769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 788/1576] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.922769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc2c3-bceb-4348-9c9b-ed6ca9e5ff1d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.931362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfc2c3-bceb-4348-9c9b-ed6ca9e5ff1d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:45.935824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 789/1577] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.937102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c8883-354b-420d-9481-47facfddcce5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.937388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c8883-354b-420d-9481-47facfddcce5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.937660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c8883-354b-420d-9481-47facfddcce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.939405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec3b35-ce55-4d06-a1b4-2d644051ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:45.940097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3b35-ce55-4d06-a1b4-2d644051ca25 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:45.940385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3b35-ce55-4d06-a1b4-2d644051ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:45.940687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3b35-ce55-4d06-a1b4-2d644051ca25 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:45.941304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec3b35-ce55-4d06-a1b4-2d644051ca25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:45.943347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec3b35-ce55-4d06-a1b4-2d644051ca25 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:45.957118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a93c8883-354b-420d-9481-47facfddcce5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:45.958402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a93c8883-354b-420d-9481-47facfddcce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:45.968491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 789/1578] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:45.969333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec3b35-ce55-4d06-a1b4-2d644051ca25 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:45.979094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec3b35-ce55-4d06-a1b4-2d644051ca25 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.020376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 790/1579] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:46.021517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c8883-354b-420d-9481-47facfddcce5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.031921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c8883-354b-420d-9481-47facfddcce5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.036644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35807540-8c19-4bf4-b8c1-38be94f3fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.037257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807540-8c19-4bf4-b8c1-38be94f3fcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.037527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807540-8c19-4bf4-b8c1-38be94f3fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.037790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35807540-8c19-4bf4-b8c1-38be94f3fcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.038456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35807540-8c19-4bf4-b8c1-38be94f3fcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.040583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35807540-8c19-4bf4-b8c1-38be94f3fcd0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.042236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6e13a-94ff-49d9-88bb-525cbb76c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.042933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e13a-94ff-49d9-88bb-525cbb76c203 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.043214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e13a-94ff-49d9-88bb-525cbb76c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.043484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e13a-94ff-49d9-88bb-525cbb76c203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.044137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6e13a-94ff-49d9-88bb-525cbb76c203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.045837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6e13a-94ff-49d9-88bb-525cbb76c203 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.057604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 790/1580] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.058227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6e13a-94ff-49d9-88bb-525cbb76c203 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.064236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 791/1581] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:46 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:46.065100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35807540-8c19-4bf4-b8c1-38be94f3fcd0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.069354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6e13a-94ff-49d9-88bb-525cbb76c203 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.069958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:46.075534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f369e-0755-4ecb-a972-c3397604d382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.076060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35807540-8c19-4bf4-b8c1-38be94f3fcd0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.076176 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f369e-0755-4ecb-a972-c3397604d382 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.076448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f369e-0755-4ecb-a972-c3397604d382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.076722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f369e-0755-4ecb-a972-c3397604d382 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.077412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f369e-0755-4ecb-a972-c3397604d382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.079909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f369e-0755-4ecb-a972-c3397604d382 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.081909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860a6e-27d1-45fd-aac1-603535fdb15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.082673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860a6e-27d1-45fd-aac1-603535fdb15d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.083045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860a6e-27d1-45fd-aac1-603535fdb15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.083421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860a6e-27d1-45fd-aac1-603535fdb15d admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.084177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5860a6e-27d1-45fd-aac1-603535fdb15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.086182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5860a6e-27d1-45fd-aac1-603535fdb15d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.103389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 791/1582] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:46 2022] POST /identity/v3/users => generated 282 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:46.104809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f369e-0755-4ecb-a972-c3397604d382 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.113832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 792/1583] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:46 2022] POST /identity/v3/users => generated 283 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:46.114819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860a6e-27d1-45fd-aac1-603535fdb15d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.115333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f369e-0755-4ecb-a972-c3397604d382 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.121701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9b93-53ce-4512-b18b-1cb011c9d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.122225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9b93-53ce-4512-b18b-1cb011c9d862 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.122570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9b93-53ce-4512-b18b-1cb011c9d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.122857 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9b93-53ce-4512-b18b-1cb011c9d862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.123556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef9b93-53ce-4512-b18b-1cb011c9d862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.125248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef9b93-53ce-4512-b18b-1cb011c9d862 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.125549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860a6e-27d1-45fd-aac1-603535fdb15d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.130168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.130804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.131077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.131339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.131998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.134326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.136976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 792/1584] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.137865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9b93-53ce-4512-b18b-1cb011c9d862 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.142971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:46.148004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9b93-53ce-4512-b18b-1cb011c9d862 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.154829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d6b7a-2c25-4432-85dd-09a580d5ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.155442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6b7a-2c25-4432-85dd-09a580d5ecba admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.155738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6b7a-2c25-4432-85dd-09a580d5ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.156001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d6b7a-2c25-4432-85dd-09a580d5ecba admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.156892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d6b7a-2c25-4432-85dd-09a580d5ecba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.160468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 793/1585] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:46 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:46.160468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.160742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d6b7a-2c25-4432-85dd-09a580d5ecba admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.160833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:46.169544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 793/1586] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.170270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d6b7a-2c25-4432-85dd-09a580d5ecba admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.180148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d6b7a-2c25-4432-85dd-09a580d5ecba admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.185917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4422fe-8a50-4e80-b0e8-a84121baa418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.186597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4422fe-8a50-4e80-b0e8-a84121baa418 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.186877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4422fe-8a50-4e80-b0e8-a84121baa418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.187148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4422fe-8a50-4e80-b0e8-a84121baa418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.187792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4422fe-8a50-4e80-b0e8-a84121baa418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.189411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4422fe-8a50-4e80-b0e8-a84121baa418 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.200843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 794/1587] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.201699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4422fe-8a50-4e80-b0e8-a84121baa418 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.213255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4422fe-8a50-4e80-b0e8-a84121baa418 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.218208 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dae66e-e3a7-483c-a5b1-dd602f98ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.218968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dae66e-e3a7-483c-a5b1-dd602f98ee53 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.219250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dae66e-e3a7-483c-a5b1-dd602f98ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.219516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dae66e-e3a7-483c-a5b1-dd602f98ee53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.220174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dae66e-e3a7-483c-a5b1-dd602f98ee53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.221840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dae66e-e3a7-483c-a5b1-dd602f98ee53 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.233050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9925b8-11da-4d4a-ace6-a5de6f19420b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.233314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 795/1588] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.234276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dae66e-e3a7-483c-a5b1-dd602f98ee53 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.237646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ca3a8-4b91-45ac-aeed-cbcad1d5a3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.238334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ca3a8-4b91-45ac-aeed-cbcad1d5a3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.238651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ca3a8-4b91-45ac-aeed-cbcad1d5a3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.238927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ca3a8-4b91-45ac-aeed-cbcad1d5a3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.245123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dae66e-e3a7-483c-a5b1-dd602f98ee53 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.250171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a6d2-dd68-4739-902b-f7342a4e012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.250523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ca3a8-4b91-45ac-aeed-cbcad1d5a3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.250860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a6d2-dd68-4739-902b-f7342a4e012b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.251136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a6d2-dd68-4739-902b-f7342a4e012b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.251404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0a6d2-dd68-4739-902b-f7342a4e012b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.251992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ca3a8-4b91-45ac-aeed-cbcad1d5a3a9 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.252105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0a6d2-dd68-4739-902b-f7342a4e012b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.253678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0a6d2-dd68-4739-902b-f7342a4e012b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.263748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 794/1589] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:46.264642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ca3a8-4b91-45ac-aeed-cbcad1d5a3a9 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.264987 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 796/1590] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.265892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a6d2-dd68-4739-902b-f7342a4e012b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.277766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0a6d2-dd68-4739-902b-f7342a4e012b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.278990 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ca3a8-4b91-45ac-aeed-cbcad1d5a3a9 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.284022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765981d2-3f31-4156-b4d9-43cfe861f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.284528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6fac-bf13-4cda-ac98-3b7466a34d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.284657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765981d2-3f31-4156-b4d9-43cfe861f244 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.284985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765981d2-3f31-4156-b4d9-43cfe861f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.285177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6fac-bf13-4cda-ac98-3b7466a34d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.285287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765981d2-3f31-4156-b4d9-43cfe861f244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.285453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6fac-bf13-4cda-ac98-3b7466a34d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.285846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6fac-bf13-4cda-ac98-3b7466a34d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.286197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765981d2-3f31-4156-b4d9-43cfe861f244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.286592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6fac-bf13-4cda-ac98-3b7466a34d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.288279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765981d2-3f31-4156-b4d9-43cfe861f244 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.288561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6fac-bf13-4cda-ac98-3b7466a34d32 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.300895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 797/1591] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.304197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 795/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.304348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765981d2-3f31-4156-b4d9-43cfe861f244 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.304470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6fac-bf13-4cda-ac98-3b7466a34d32 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.314581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765981d2-3f31-4156-b4d9-43cfe861f244 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.316339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6fac-bf13-4cda-ac98-3b7466a34d32 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.319773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03697b-de52-4eff-8f9d-2a4ae2bdf793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.320475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03697b-de52-4eff-8f9d-2a4ae2bdf793 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.320717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03697b-de52-4eff-8f9d-2a4ae2bdf793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.321091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03697b-de52-4eff-8f9d-2a4ae2bdf793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.322033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03697b-de52-4eff-8f9d-2a4ae2bdf793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.323427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d965d7f-38a6-4d5c-ba0d-396f5e3740ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.323974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03697b-de52-4eff-8f9d-2a4ae2bdf793 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.324107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d965d7f-38a6-4d5c-ba0d-396f5e3740ae admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.324478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d965d7f-38a6-4d5c-ba0d-396f5e3740ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.325023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d965d7f-38a6-4d5c-ba0d-396f5e3740ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.325819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d965d7f-38a6-4d5c-ba0d-396f5e3740ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.327587 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d965d7f-38a6-4d5c-ba0d-396f5e3740ae admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.337230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 798/1593] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.338649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03697b-de52-4eff-8f9d-2a4ae2bdf793 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.342164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 796/1594] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.342164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d965d7f-38a6-4d5c-ba0d-396f5e3740ae admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.350691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d965d7f-38a6-4d5c-ba0d-396f5e3740ae admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.352814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03697b-de52-4eff-8f9d-2a4ae2bdf793 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.357321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150d1b-8f55-4d46-8f03-101385819d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.358116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150d1b-8f55-4d46-8f03-101385819d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.358636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150d1b-8f55-4d46-8f03-101385819d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.359189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150d1b-8f55-4d46-8f03-101385819d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.359872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8d160-1428-415f-95d8-1f0064f0dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.360143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74150d1b-8f55-4d46-8f03-101385819d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.360687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d160-1428-415f-95d8-1f0064f0dea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.360993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d160-1428-415f-95d8-1f0064f0dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.361244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d160-1428-415f-95d8-1f0064f0dea6 admin admin] PATH_INFO: `/v3/projects/d4490cb75d5c4967b11f8d86175d4bfc/users/854b814af31447178cddcace042a0a23/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.362304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74150d1b-8f55-4d46-8f03-101385819d80 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.377312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 797/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.378492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150d1b-8f55-4d46-8f03-101385819d80 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.385943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8d160-1428-415f-95d8-1f0064f0dea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4490cb75d5c4967b11f8d86175d4bfc, user_id=854b814af31447178cddcace042a0a23, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.389500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8d160-1428-415f-95d8-1f0064f0dea6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.390486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150d1b-8f55-4d46-8f03-101385819d80 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.395574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e514164-b54c-49b9-b047-5f87ecf768b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.396261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514164-b54c-49b9-b047-5f87ecf768b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.396571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514164-b54c-49b9-b047-5f87ecf768b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.396865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514164-b54c-49b9-b047-5f87ecf768b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.397608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e514164-b54c-49b9-b047-5f87ecf768b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.399464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e514164-b54c-49b9-b047-5f87ecf768b2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.407334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 799/1596] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:46 2022] PUT /identity/v3/projects/d4490cb75d5c4967b11f8d86175d4bfc/users/854b814af31447178cddcace042a0a23/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:46.408416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8d160-1428-415f-95d8-1f0064f0dea6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.423681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 798/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.426847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e514164-b54c-49b9-b047-5f87ecf768b2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.438799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e514164-b54c-49b9-b047-5f87ecf768b2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.499348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8d160-1428-415f-95d8-1f0064f0dea6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.508194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082b9f-264f-4083-b108-6beed2989790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.509140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082b9f-264f-4083-b108-6beed2989790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.509521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082b9f-264f-4083-b108-6beed2989790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.509852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082b9f-264f-4083-b108-6beed2989790 admin admin] PATH_INFO: `/v3/projects/3161456a45ae4d9fa1c6b2ab9a5c8ca2/users/5b64acf3f19a40ca869bf9070bad361b/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.519559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881d88-2c39-4650-b046-d56749f8c73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.520543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881d88-2c39-4650-b046-d56749f8c73c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.520820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881d88-2c39-4650-b046-d56749f8c73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.521135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881d88-2c39-4650-b046-d56749f8c73c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.521782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66881d88-2c39-4650-b046-d56749f8c73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.524699 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66881d88-2c39-4650-b046-d56749f8c73c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.529860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70082b9f-264f-4083-b108-6beed2989790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3161456a45ae4d9fa1c6b2ab9a5c8ca2, user_id=5b64acf3f19a40ca869bf9070bad361b, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.533061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70082b9f-264f-4083-b108-6beed2989790 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.538156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 799/1598] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.539271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881d88-2c39-4650-b046-d56749f8c73c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.552251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881d88-2c39-4650-b046-d56749f8c73c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.554478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 800/1599] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:46 2022] PUT /identity/v3/projects/3161456a45ae4d9fa1c6b2ab9a5c8ca2/users/5b64acf3f19a40ca869bf9070bad361b/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:46.555301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082b9f-264f-4083-b108-6beed2989790 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.574676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:46.625347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7988-d3ff-4099-84c6-327b93c826e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.625984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7988-d3ff-4099-84c6-327b93c826e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.626267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7988-d3ff-4099-84c6-327b93c826e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.626559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7988-d3ff-4099-84c6-327b93c826e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.627205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc7988-d3ff-4099-84c6-327b93c826e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.628445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:46.628927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc7988-d3ff-4099-84c6-327b93c826e5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.634779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082b9f-264f-4083-b108-6beed2989790 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.640960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 800/1600] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:46.641694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7988-d3ff-4099-84c6-327b93c826e5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.643483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d998e-d466-4065-9c21-d33e76a13856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.644439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d998e-d466-4065-9c21-d33e76a13856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.644835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d998e-d466-4065-9c21-d33e76a13856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.645207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d998e-d466-4065-9c21-d33e76a13856 admin admin] PATH_INFO: `/v3/projects/83a4b9108dfb44708ec870a416c8a25f/users/20b59698598b4eb6b7eb2bdbbeb6b341/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.652165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7988-d3ff-4099-84c6-327b93c826e5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.657373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634c66-032c-4f3b-9534-814d36eaba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.658056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634c66-032c-4f3b-9534-814d36eaba52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.658416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634c66-032c-4f3b-9534-814d36eaba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.658689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634c66-032c-4f3b-9534-814d36eaba52 admin admin] PATH_INFO: `/v3/projects/5ba8340939244ecab134924353f7973d/users/96fb8269dcc14300912fb686e47b988f/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.668446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d998e-d466-4065-9c21-d33e76a13856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a4b9108dfb44708ec870a416c8a25f, user_id=20b59698598b4eb6b7eb2bdbbeb6b341, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.672470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d998e-d466-4065-9c21-d33e76a13856 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.681691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef634c66-032c-4f3b-9534-814d36eaba52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba8340939244ecab134924353f7973d, user_id=96fb8269dcc14300912fb686e47b988f, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.685623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef634c66-032c-4f3b-9534-814d36eaba52 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.693949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 801/1601] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:46 2022] PUT /identity/v3/projects/83a4b9108dfb44708ec870a416c8a25f/users/20b59698598b4eb6b7eb2bdbbeb6b341/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:46.695888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362cec-4081-4bc5-b483-cfb27372b7eb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.696242 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362cec-4081-4bc5-b483-cfb27372b7eb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.696564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4362cec-4081-4bc5-b483-cfb27372b7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.719043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 801/1602] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:46 2022] PUT /identity/v3/projects/5ba8340939244ecab134924353f7973d/users/96fb8269dcc14300912fb686e47b988f/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:46.720006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634c66-032c-4f3b-9534-814d36eaba52 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.744985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e4362cec-4081-4bc5-b483-cfb27372b7eb None None] MFA Rules not processed for user `854b814af31447178cddcace042a0a23`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:46.746213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e4362cec-4081-4bc5-b483-cfb27372b7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:46.826472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634c66-032c-4f3b-9534-814d36eaba52 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.832880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43c50-f3ee-485f-a47c-b927b8e931e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.833573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43c50-f3ee-485f-a47c-b927b8e931e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.833850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43c50-f3ee-485f-a47c-b927b8e931e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.834122 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43c50-f3ee-485f-a47c-b927b8e931e7 admin admin] PATH_INFO: `/v3/projects/464590c74fa44fd49477a80465f18a63/users/cd47e454e8be4469926d3783f78a18ad/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.834348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 802/1603] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:46.835531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4362cec-4081-4bc5-b483-cfb27372b7eb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.851280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4362cec-4081-4bc5-b483-cfb27372b7eb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.855441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43c50-f3ee-485f-a47c-b927b8e931e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=464590c74fa44fd49477a80465f18a63, user_id=cd47e454e8be4469926d3783f78a18ad, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.858181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43c50-f3ee-485f-a47c-b927b8e931e7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.858454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfbba7-5948-42ef-ac38-65dd94e64574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.859251 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfbba7-5948-42ef-ac38-65dd94e64574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.859632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfbba7-5948-42ef-ac38-65dd94e64574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.860014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfbba7-5948-42ef-ac38-65dd94e64574 admin admin] PATH_INFO: `/v3/projects/41d41206e0c04b379175e6481ad4f90a/users/e3fbb46762664c5d8ce9f4dfdbb5f4f8/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.878443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 802/1604] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:46 2022] PUT /identity/v3/projects/464590c74fa44fd49477a80465f18a63/users/cd47e454e8be4469926d3783f78a18ad/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:46.878443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb60ff-2830-4425-b09e-4f4b05ccc804 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.878443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb60ff-2830-4425-b09e-4f4b05ccc804 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.878443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb60ff-2830-4425-b09e-4f4b05ccc804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.886786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfbba7-5948-42ef-ac38-65dd94e64574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d41206e0c04b379175e6481ad4f90a, user_id=e3fbb46762664c5d8ce9f4dfdbb5f4f8, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:46.889485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfbba7-5948-42ef-ac38-65dd94e64574 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:46.906077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 803/1605] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:46 2022] PUT /identity/v3/projects/41d41206e0c04b379175e6481ad4f90a/users/e3fbb46762664c5d8ce9f4dfdbb5f4f8/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:46.906874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0abb60ff-2830-4425-b09e-4f4b05ccc804 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:46.907177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfbba7-5948-42ef-ac38-65dd94e64574 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:46.909163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0abb60ff-2830-4425-b09e-4f4b05ccc804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:46.987554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfbba7-5948-42ef-ac38-65dd94e64574 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:46.993806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 803/1606] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:46.994428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0475d7-85f9-42f5-8c14-60c5419448dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:46.995237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0475d7-85f9-42f5-8c14-60c5419448dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.995572 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0475d7-85f9-42f5-8c14-60c5419448dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.996007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0475d7-85f9-42f5-8c14-60c5419448dc admin admin] PATH_INFO: `/v3/projects/c07d03c1dfb94639985ba1f30cadc3b5/users/98468f7877eb48889976ecba85a776ef/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:46.996263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1ec40-831e-41eb-8471-160c6731acbc None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:46.996701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1ec40-831e-41eb-8471-160c6731acbc None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:46.997135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1ec40-831e-41eb-8471-160c6731acbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.018182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0475d7-85f9-42f5-8c14-60c5419448dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07d03c1dfb94639985ba1f30cadc3b5, user_id=98468f7877eb48889976ecba85a776ef, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:47.021395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0475d7-85f9-42f5-8c14-60c5419448dc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:47.036373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4af1ec40-831e-41eb-8471-160c6731acbc None None] MFA Rules not processed for user `20b59698598b4eb6b7eb2bdbbeb6b341`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:47.037561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4af1ec40-831e-41eb-8471-160c6731acbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:47.043470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 804/1607] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:46 2022] PUT /identity/v3/projects/c07d03c1dfb94639985ba1f30cadc3b5/users/98468f7877eb48889976ecba85a776ef/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:47.043470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd13dc-43c9-4772-b31d-215976f52ec6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.043470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd13dc-43c9-4772-b31d-215976f52ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.043470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd13dc-43c9-4772-b31d-215976f52ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.045193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:47.077471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6ccd13dc-43c9-4772-b31d-215976f52ec6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:47.083587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6ccd13dc-43c9-4772-b31d-215976f52ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:47.115201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:47.145758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 804/1608] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:47.146973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1ec40-831e-41eb-8471-160c6731acbc None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:47.210145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 805/1609] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:47.225923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1299a7c-4af2-4264-8b09-b24e03b4e49d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.226755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1299a7c-4af2-4264-8b09-b24e03b4e49d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.227029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1299a7c-4af2-4264-8b09-b24e03b4e49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.249703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1ec40-831e-41eb-8471-160c6731acbc None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:47.257400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fdc3-7f7b-49ef-bc03-04e0ce98e255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:47.259654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fdc3-7f7b-49ef-bc03-04e0ce98e255 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.260145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fdc3-7f7b-49ef-bc03-04e0ce98e255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.260582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fdc3-7f7b-49ef-bc03-04e0ce98e255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.261701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fdc3-7f7b-49ef-bc03-04e0ce98e255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:47.264236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fdc3-7f7b-49ef-bc03-04e0ce98e255 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:47.274143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d1299a7c-4af2-4264-8b09-b24e03b4e49d None None] MFA Rules not processed for user `cd47e454e8be4469926d3783f78a18ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:47.275984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d1299a7c-4af2-4264-8b09-b24e03b4e49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:47.308558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 805/1610] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:47 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:47.308558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588140a-7b95-43fe-9e6c-09c191306502 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.308558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588140a-7b95-43fe-9e6c-09c191306502 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.308558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588140a-7b95-43fe-9e6c-09c191306502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.342072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d588140a-7b95-43fe-9e6c-09c191306502 None None] MFA Rules not processed for user `e3fbb46762664c5d8ce9f4dfdbb5f4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:47.343574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d588140a-7b95-43fe-9e6c-09c191306502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:47.379265 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 806/1611] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:47.386431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1299a7c-4af2-4264-8b09-b24e03b4e49d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:47.432286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 806/1612] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:47.435224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b61a-aa76-49c9-842f-ab78d096f14e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.436820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b61a-aa76-49c9-842f-ab78d096f14e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.437098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b61a-aa76-49c9-842f-ab78d096f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.461015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-37d9b61a-aa76-49c9-842f-ab78d096f14e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:47.462649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-37d9b61a-aa76-49c9-842f-ab78d096f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:47.480176 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1299a7c-4af2-4264-8b09-b24e03b4e49d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:47.484740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:47.561282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 807/1613] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:47.563604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4dc56-a105-41fe-8c55-e94d4b96d7b5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.564115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4dc56-a105-41fe-8c55-e94d4b96d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.569915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b213cf9-efa4-4fde-823d-e78cbb77d1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:47.571143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213cf9-efa4-4fde-823d-e78cbb77d1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.571547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213cf9-efa4-4fde-823d-e78cbb77d1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.571733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4dc56-a105-41fe-8c55-e94d4b96d7b5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.571953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213cf9-efa4-4fde-823d-e78cbb77d1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.578254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 808/1614] 10.222.0.49 () {54 vars in 962 bytes} [Tue Aug 30 14:43:47 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:43:47.580108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4dc56-a105-41fe-8c55-e94d4b96d7b5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:47.586353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b213cf9-efa4-4fde-823d-e78cbb77d1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:47.588862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b213cf9-efa4-4fde-823d-e78cbb77d1a4 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:47.593592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4dc56-a105-41fe-8c55-e94d4b96d7b5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:47.599251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90ce0-724a-49b6-bb9c-ac9c844fc18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:47.600324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90ce0-724a-49b6-bb9c-ac9c844fc18a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.600764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90ce0-724a-49b6-bb9c-ac9c844fc18a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.601181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90ce0-724a-49b6-bb9c-ac9c844fc18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.609352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 807/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:47.610685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b213cf9-efa4-4fde-823d-e78cbb77d1a4 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:47.612900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90ce0-724a-49b6-bb9c-ac9c844fc18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:47.614589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90ce0-724a-49b6-bb9c-ac9c844fc18a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:47.629301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b213cf9-efa4-4fde-823d-e78cbb77d1a4 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:47.636831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2aede-f0f5-4c8f-910a-db2cd7900513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:47.637929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2aede-f0f5-4c8f-910a-db2cd7900513 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.638131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 809/1616] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:47.638674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2aede-f0f5-4c8f-910a-db2cd7900513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.638903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2aede-f0f5-4c8f-910a-db2cd7900513 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.639150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90ce0-724a-49b6-bb9c-ac9c844fc18a service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:47.639770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2aede-f0f5-4c8f-910a-db2cd7900513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:47.642957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2aede-f0f5-4c8f-910a-db2cd7900513 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:47.666877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90ce0-724a-49b6-bb9c-ac9c844fc18a service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:47.675948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:47.679266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ecb85-1d74-44f8-8a17-6e3772b465bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:47.680022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ecb85-1d74-44f8-8a17-6e3772b465bb admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.680558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ecb85-1d74-44f8-8a17-6e3772b465bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.685830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ecb85-1d74-44f8-8a17-6e3772b465bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.686983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ecb85-1d74-44f8-8a17-6e3772b465bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:47.689043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ecb85-1d74-44f8-8a17-6e3772b465bb admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:47.692688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 808/1617] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:47 2022] POST /identity/v3/users => generated 288 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:47.694249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2aede-f0f5-4c8f-910a-db2cd7900513 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:47.758485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 810/1618] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:47 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:47.759654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ecb85-1d74-44f8-8a17-6e3772b465bb admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:47.796956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2aede-f0f5-4c8f-910a-db2cd7900513 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:47.888846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ecb85-1d74-44f8-8a17-6e3772b465bb admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:47.891837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1cf5c-f25a-4a5b-ad8d-298884c4c893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:47.891837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1cf5c-f25a-4a5b-ad8d-298884c4c893 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.891837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1cf5c-f25a-4a5b-ad8d-298884c4c893 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.892285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1cf5c-f25a-4a5b-ad8d-298884c4c893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:47.905526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c707c-e645-4926-98f7-766036329d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:47.907080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c707c-e645-4926-98f7-766036329d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:47.907412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c707c-e645-4926-98f7-766036329d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:47.908004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c707c-e645-4926-98f7-766036329d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:48.031936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c707c-e645-4926-98f7-766036329d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:48.035276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c707c-e645-4926-98f7-766036329d1a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:48.042526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1cf5c-f25a-4a5b-ad8d-298884c4c893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:48.045067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1cf5c-f25a-4a5b-ad8d-298884c4c893 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:48.050728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 811/1619] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:48.053338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4961ba-7a9a-4d44-a3f9-b2363315228b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:48.053898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4961ba-7a9a-4d44-a3f9-b2363315228b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:48.054173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4961ba-7a9a-4d44-a3f9-b2363315228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:48.081057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 809/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:48.084721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1cf5c-f25a-4a5b-ad8d-298884c4c893 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:48.104594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1cf5c-f25a-4a5b-ad8d-298884c4c893 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:48.114904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4187-cef5-4fbe-bdfe-dc257a585318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:48.116297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4187-cef5-4fbe-bdfe-dc257a585318 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:48.116937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4187-cef5-4fbe-bdfe-dc257a585318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:48.117557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4187-cef5-4fbe-bdfe-dc257a585318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:48.118962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c4187-cef5-4fbe-bdfe-dc257a585318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:48.121544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c4187-cef5-4fbe-bdfe-dc257a585318 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:48.143271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 810/1621] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:48.143271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4187-cef5-4fbe-bdfe-dc257a585318 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:48.157800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4187-cef5-4fbe-bdfe-dc257a585318 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:48.168973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6f4961ba-7a9a-4d44-a3f9-b2363315228b None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:48.275512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6f4961ba-7a9a-4d44-a3f9-b2363315228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:48.278908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ffce6-9491-42bf-b026-70eab28d31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:48.278908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ffce6-9491-42bf-b026-70eab28d31fd admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:48.278908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ffce6-9491-42bf-b026-70eab28d31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:48.278908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ffce6-9491-42bf-b026-70eab28d31fd admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:48.279637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ffce6-9491-42bf-b026-70eab28d31fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:48.279637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ffce6-9491-42bf-b026-70eab28d31fd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:48.280011 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:48.280398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 811/1622] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:48 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:48.280398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ffce6-9491-42bf-b026-70eab28d31fd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:48.290254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ffce6-9491-42bf-b026-70eab28d31fd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:48.304094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dc102-8eef-4a8a-a405-909c4c9a14f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:48.304805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dc102-8eef-4a8a-a405-909c4c9a14f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:48.305078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dc102-8eef-4a8a-a405-909c4c9a14f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:48.305501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dc102-8eef-4a8a-a405-909c4c9a14f9 admin admin] PATH_INFO: `/v3/projects/5f47f8b406d7477eadc7f85d58e5b88d/users/7ce51826038b482cbc4efe671475172f/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:48.333123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dc102-8eef-4a8a-a405-909c4c9a14f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f47f8b406d7477eadc7f85d58e5b88d, user_id=7ce51826038b482cbc4efe671475172f, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:48.338554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dc102-8eef-4a8a-a405-909c4c9a14f9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:48.378452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 812/1623] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:48 2022] PUT /identity/v3/projects/5f47f8b406d7477eadc7f85d58e5b88d/users/7ce51826038b482cbc4efe671475172f/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:48.378452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dc102-8eef-4a8a-a405-909c4c9a14f9 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:48.411384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 812/1624] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Aug 30 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:48.413904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4961ba-7a9a-4d44-a3f9-b2363315228b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:48.453014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4961ba-7a9a-4d44-a3f9-b2363315228b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:48.504916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:48.614013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666594b7-a6f1-4408-979b-d75d9d702c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:48.614681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666594b7-a6f1-4408-979b-d75d9d702c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:48.614880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666594b7-a6f1-4408-979b-d75d9d702c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:48.615337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666594b7-a6f1-4408-979b-d75d9d702c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:48.616038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666594b7-a6f1-4408-979b-d75d9d702c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:48.618886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666594b7-a6f1-4408-979b-d75d9d702c63 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:48.646972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 813/1625] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:48.653186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666594b7-a6f1-4408-979b-d75d9d702c63 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:48.673534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dc102-8eef-4a8a-a405-909c4c9a14f9 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:48.697617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4355f94-11ab-479c-bc46-1368968ea20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:48.701805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355f94-11ab-479c-bc46-1368968ea20a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:48.702459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355f94-11ab-479c-bc46-1368968ea20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:48.702773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355f94-11ab-479c-bc46-1368968ea20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:48.703457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4355f94-11ab-479c-bc46-1368968ea20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:48.717319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4355f94-11ab-479c-bc46-1368968ea20a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:48.764854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 813/1626] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:48.766975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4355f94-11ab-479c-bc46-1368968ea20a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:48.791885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4355f94-11ab-479c-bc46-1368968ea20a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:48.807436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc35f9-e315-4039-bfc0-314c941e436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:48.808179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc35f9-e315-4039-bfc0-314c941e436f admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:48.808555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc35f9-e315-4039-bfc0-314c941e436f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:48.808838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc35f9-e315-4039-bfc0-314c941e436f admin admin] PATH_INFO: `/v3/projects/5f47f8b406d7477eadc7f85d58e5b88d/users/7ce51826038b482cbc4efe671475172f/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:48.812238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc35f9-e315-4039-bfc0-314c941e436f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f47f8b406d7477eadc7f85d58e5b88d, user_id=7ce51826038b482cbc4efe671475172f, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:48.819778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc35f9-e315-4039-bfc0-314c941e436f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:48.835188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666594b7-a6f1-4408-979b-d75d9d702c63 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:48.848757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 814/1627] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:48 2022] PUT /identity/v3/projects/5f47f8b406d7477eadc7f85d58e5b88d/users/7ce51826038b482cbc4efe671475172f/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:48.850347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc35f9-e315-4039-bfc0-314c941e436f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:48.864450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37124a05-68e6-4cc4-acc0-a2f55f2b6aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:48.865120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37124a05-68e6-4cc4-acc0-a2f55f2b6aa4 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:48.865464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37124a05-68e6-4cc4-acc0-a2f55f2b6aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:48.865809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37124a05-68e6-4cc4-acc0-a2f55f2b6aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:49.007245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc35f9-e315-4039-bfc0-314c941e436f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:49.029377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7585a5-01fd-4ad6-a1da-758240c11e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:49.030079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7585a5-01fd-4ad6-a1da-758240c11e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:49.030354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7585a5-01fd-4ad6-a1da-758240c11e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:49.030648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7585a5-01fd-4ad6-a1da-758240c11e29 admin admin] PATH_INFO: `/v3/projects/3d44a5d46850456d9030ca7db8478da5/users/a56a9e954b6a48c6bd1a8afce888ac76/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:49.037129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:49.062236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37124a05-68e6-4cc4-acc0-a2f55f2b6aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:49.063977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37124a05-68e6-4cc4-acc0-a2f55f2b6aa4 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:49.067263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7585a5-01fd-4ad6-a1da-758240c11e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d44a5d46850456d9030ca7db8478da5, user_id=a56a9e954b6a48c6bd1a8afce888ac76, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:49.070840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7585a5-01fd-4ad6-a1da-758240c11e29 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:49.093163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 814/1628] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:49.094229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998d8ee-94ce-41be-8a4a-6fe04c830d0e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:49.101868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998d8ee-94ce-41be-8a4a-6fe04c830d0e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:49.102110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 815/1629] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:48 2022] PUT /identity/v3/projects/3d44a5d46850456d9030ca7db8478da5/users/a56a9e954b6a48c6bd1a8afce888ac76/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:49.102871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998d8ee-94ce-41be-8a4a-6fe04c830d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:49.109458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7585a5-01fd-4ad6-a1da-758240c11e29 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:49.150832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9998d8ee-94ce-41be-8a4a-6fe04c830d0e None None] MFA Rules not processed for user `7ce51826038b482cbc4efe671475172f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:49.155168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9998d8ee-94ce-41be-8a4a-6fe04c830d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:49.269779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7585a5-01fd-4ad6-a1da-758240c11e29 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:49.278584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049e062-38b3-4c71-a37f-dfd4dea79324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:49.280392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e062-38b3-4c71-a37f-dfd4dea79324 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:49.280392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e062-38b3-4c71-a37f-dfd4dea79324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:49.280392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049e062-38b3-4c71-a37f-dfd4dea79324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:49.280873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049e062-38b3-4c71-a37f-dfd4dea79324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:49.282819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049e062-38b3-4c71-a37f-dfd4dea79324 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:49.299856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 816/1630] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:43:49.304309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049e062-38b3-4c71-a37f-dfd4dea79324 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:49.310827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 815/1631] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:49.317088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049e062-38b3-4c71-a37f-dfd4dea79324 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:49.323438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998d8ee-94ce-41be-8a4a-6fe04c830d0e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:49.323703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755ceb5-9dd0-4306-b50e-a9c5559d3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:49.324295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755ceb5-9dd0-4306-b50e-a9c5559d3268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:49.324639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755ceb5-9dd0-4306-b50e-a9c5559d3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:49.324975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755ceb5-9dd0-4306-b50e-a9c5559d3268 admin admin] PATH_INFO: `/v3/projects/3d44a5d46850456d9030ca7db8478da5/users/a56a9e954b6a48c6bd1a8afce888ac76/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:49.327926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755ceb5-9dd0-4306-b50e-a9c5559d3268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d44a5d46850456d9030ca7db8478da5, user_id=a56a9e954b6a48c6bd1a8afce888ac76, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:49.333232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755ceb5-9dd0-4306-b50e-a9c5559d3268 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:49.351467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 817/1632] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:49 2022] PUT /identity/v3/projects/3d44a5d46850456d9030ca7db8478da5/users/a56a9e954b6a48c6bd1a8afce888ac76/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:49.363502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883e48-1c7b-4938-8b74-8b9f4996c762 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:49.365373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883e48-1c7b-4938-8b74-8b9f4996c762 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:49.366284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883e48-1c7b-4938-8b74-8b9f4996c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:49.388834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:49.459817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fc883e48-1c7b-4938-8b74-8b9f4996c762 None None] MFA Rules not processed for user `a56a9e954b6a48c6bd1a8afce888ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:49.461195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998d8ee-94ce-41be-8a4a-6fe04c830d0e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:49.464274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fc883e48-1c7b-4938-8b74-8b9f4996c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:49.565446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e56f5-4271-4bf1-ada9-ff625d4f0fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:49.566399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e56f5-4271-4bf1-ada9-ff625d4f0fdd service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:49.566745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e56f5-4271-4bf1-ada9-ff625d4f0fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:49.569580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e56f5-4271-4bf1-ada9-ff625d4f0fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:49.629983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 818/1633] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:49.644829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc883e48-1c7b-4938-8b74-8b9f4996c762 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:49.659180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc883e48-1c7b-4938-8b74-8b9f4996c762 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:49.664361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c485-824f-46c8-b41e-9c205b5b41f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:49.665349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c485-824f-46c8-b41e-9c205b5b41f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:49.665695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c485-824f-46c8-b41e-9c205b5b41f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:49.666363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c485-824f-46c8-b41e-9c205b5b41f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:49.677553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9c485-824f-46c8-b41e-9c205b5b41f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:49.679240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9c485-824f-46c8-b41e-9c205b5b41f0 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:49.686144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:49.691718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 819/1634] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:49.727259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e56f5-4271-4bf1-ada9-ff625d4f0fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:49.729484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e56f5-4271-4bf1-ada9-ff625d4f0fdd service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:49.760067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 816/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:49.933935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c485-824f-46c8-b41e-9c205b5b41f0 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:49.945177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c485-824f-46c8-b41e-9c205b5b41f0 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:49.961819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab309151-be46-4afa-9b12-b89c96f7b491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:49.962690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab309151-be46-4afa-9b12-b89c96f7b491 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:49.963238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab309151-be46-4afa-9b12-b89c96f7b491 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:49.965557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab309151-be46-4afa-9b12-b89c96f7b491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.154145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab309151-be46-4afa-9b12-b89c96f7b491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:50.155645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab309151-be46-4afa-9b12-b89c96f7b491 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:50.188889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 820/1636] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:50.270205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2faf02-d9ce-485d-8dfc-928b5f9e60e5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:50.270205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2faf02-d9ce-485d-8dfc-928b5f9e60e5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:50.270205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2faf02-d9ce-485d-8dfc-928b5f9e60e5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.271723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 817/1637] 10.222.0.49 () {54 vars in 962 bytes} [Tue Aug 30 14:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:43:50.281293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09633ee-a8b6-4244-a22c-618c7d00d3de None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:50.281740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09633ee-a8b6-4244-a22c-618c7d00d3de None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:50.281874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09633ee-a8b6-4244-a22c-618c7d00d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.331404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d09633ee-a8b6-4244-a22c-618c7d00d3de None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:50.332997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d09633ee-a8b6-4244-a22c-618c7d00d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:50.479329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56f6f-a443-4615-9933-52218caeb6f9 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:50.479600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56f6f-a443-4615-9933-52218caeb6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:50.479862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56f6f-a443-4615-9933-52218caeb6f9 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.481267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 818/1638] 10.222.0.49 () {54 vars in 912 bytes} [Tue Aug 30 14:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:43:50.504092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19d9a-b94d-47c1-b290-261f7aba586d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:50.504371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19d9a-b94d-47c1-b290-261f7aba586d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:50.504641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19d9a-b94d-47c1-b290-261f7aba586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.547759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-30e19d9a-b94d-47c1-b290-261f7aba586d None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:50.549156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-30e19d9a-b94d-47c1-b290-261f7aba586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:50.562984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 821/1639] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Aug 30 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:50.564789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb15c62-d966-46e5-a37a-a71144d810b0 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:50.565152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb15c62-d966-46e5-a37a-a71144d810b0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:50.568794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb15c62-d966-46e5-a37a-a71144d810b0 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.571435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 819/1640] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:43:50.581358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8322b-20f1-4e79-8aa8-1246004b40ee None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:50.581757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8322b-20f1-4e79-8aa8-1246004b40ee None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:50.582099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8322b-20f1-4e79-8aa8-1246004b40ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.590261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 822/1641] 10.222.0.49 () {54 vars in 912 bytes} [Tue Aug 30 14:43:50 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:43:50.616923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb15c62-d966-46e5-a37a-a71144d810b0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:50.621202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-96b8322b-20f1-4e79-8aa8-1246004b40ee None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:50.622935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-96b8322b-20f1-4e79-8aa8-1246004b40ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:50.634715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb15c62-d966-46e5-a37a-a71144d810b0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:50.648714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 820/1642] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:43:50.657925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b73a0-7c72-4c66-a5f6-9c6abd674dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:50.658701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b73a0-7c72-4c66-a5f6-9c6abd674dfa service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:50.659699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b73a0-7c72-4c66-a5f6-9c6abd674dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:50.660058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b73a0-7c72-4c66-a5f6-9c6abd674dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.672689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:50.680973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b73a0-7c72-4c66-a5f6-9c6abd674dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:50.684423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b73a0-7c72-4c66-a5f6-9c6abd674dfa service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:50.700524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 823/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:43:50.793827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8322b-20f1-4e79-8aa8-1246004b40ee None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:50.808540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8322b-20f1-4e79-8aa8-1246004b40ee None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:50.820603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10579689-ccdb-4457-96d8-3b3285cd38b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:50.824657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579689-ccdb-4457-96d8-3b3285cd38b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:50.826673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579689-ccdb-4457-96d8-3b3285cd38b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:50.827128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579689-ccdb-4457-96d8-3b3285cd38b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:50.857533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10579689-ccdb-4457-96d8-3b3285cd38b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:50.861866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10579689-ccdb-4457-96d8-3b3285cd38b4 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:50.892618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 821/1644] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:51.448392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b73a0-7c72-4c66-a5f6-9c6abd674dfa service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:51.607063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b73a0-7c72-4c66-a5f6-9c6abd674dfa service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:51.610741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10579689-ccdb-4457-96d8-3b3285cd38b4 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:51.629429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10579689-ccdb-4457-96d8-3b3285cd38b4 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:51.640065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:51.644644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:51.645233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:51.646140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] PATH_INFO: `/v3/users/20b59698598b4eb6b7eb2bdbbeb6b341` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:51.654227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b59698598b4eb6b7eb2bdbbeb6b341)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:51.659446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:51.661158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:51.661301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:51.662752 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:51.677290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] PATH_INFO: `/v3/users/854b814af31447178cddcace042a0a23` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:51.680189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854b814af31447178cddcace042a0a23)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:51.686702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: WARNING py.warnings [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:43:51.686702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: warnings.warn(msg) Aug 30 14:43:51.686702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: Aug 30 14:43:51.689095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:51.802723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b59698598b4eb6b7eb2bdbbeb6b341'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.837107 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b59698598b4eb6b7eb2bdbbeb6b341'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.857397 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b59698598b4eb6b7eb2bdbbeb6b341'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.859469 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b59698598b4eb6b7eb2bdbbeb6b341'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.860597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-46dd9665-105c-473e-a7d1-3a7d1035dfca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b59698598b4eb6b7eb2bdbbeb6b341'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.895701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854b814af31447178cddcace042a0a23'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.898000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 824/1645] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:43:51 2022] DELETE /identity/v3/users/20b59698598b4eb6b7eb2bdbbeb6b341 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:51.900105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f51ea-078e-4382-a3a4-2d0e2e411771 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:51.900518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f51ea-078e-4382-a3a4-2d0e2e411771 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:51.902703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f51ea-078e-4382-a3a4-2d0e2e411771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:51.955482 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854b814af31447178cddcace042a0a23'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.957583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854b814af31447178cddcace042a0a23'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.960895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854b814af31447178cddcace042a0a23'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.981606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-702f1dee-99fe-4f75-ba2d-5c6d51aeb4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854b814af31447178cddcace042a0a23'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:51.994246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-677f51ea-078e-4382-a3a4-2d0e2e411771 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:51.996183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-677f51ea-078e-4382-a3a4-2d0e2e411771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:52.060624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 822/1646] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:43:51 2022] DELETE /identity/v3/users/854b814af31447178cddcace042a0a23 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:52.062436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294537d3-2cf1-4341-98b0-8fdbf87414b6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:52.062731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294537d3-2cf1-4341-98b0-8fdbf87414b6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:52.063006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294537d3-2cf1-4341-98b0-8fdbf87414b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:52.139343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-294537d3-2cf1-4341-98b0-8fdbf87414b6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:52.150963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-294537d3-2cf1-4341-98b0-8fdbf87414b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:52.185112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 825/1647] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:52.225783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f51ea-078e-4382-a3a4-2d0e2e411771 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:52.228688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-677f51ea-078e-4382-a3a4-2d0e2e411771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:52.276126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:52.405015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 823/1648] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:52.415821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f51ea-078e-4382-a3a4-2d0e2e411771 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:52.484886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294537d3-2cf1-4341-98b0-8fdbf87414b6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:52.563803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:52.565859 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:52.566445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:52.568512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:52.589698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:52.594528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:52.617030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 826/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:43:52.640977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:52.748009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294537d3-2cf1-4341-98b0-8fdbf87414b6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:52.766425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb43586-6d31-42b2-b69a-9db45e67e55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:52.767454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43586-6d31-42b2-b69a-9db45e67e55b service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:52.767910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43586-6d31-42b2-b69a-9db45e67e55b service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:52.768362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43586-6d31-42b2-b69a-9db45e67e55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:52.808872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb43586-6d31-42b2-b69a-9db45e67e55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:52.811660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb43586-6d31-42b2-b69a-9db45e67e55b service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:52.869491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 824/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:43:53.863637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:53.867541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:53.903010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f282c9d-8ec8-44e0-958b-34b1f25ce3fd service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:53.907086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:53.907765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:53.908040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:53.908310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] PATH_INFO: `/v3/projects/83a4b9108dfb44708ec870a416c8a25f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:53.909776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a4b9108dfb44708ec870a416c8a25f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:53.911353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: WARNING py.warnings [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 14:43:53.911353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: warnings.warn(msg) Aug 30 14:43:53.911353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: Aug 30 14:43:53.912919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:54.002873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a4b9108dfb44708ec870a416c8a25f', 'request_id': 'req-b1d2380e-1341-4d84-b976-4d6c449ecf70'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.055342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a4b9108dfb44708ec870a416c8a25f', 'request_id': 'req-b1d2380e-1341-4d84-b976-4d6c449ecf70'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.084603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a4b9108dfb44708ec870a416c8a25f', 'request_id': 'req-b1d2380e-1341-4d84-b976-4d6c449ecf70'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.113424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] The token cache is being invalidate because project 83a4b9108dfb44708ec870a416c8a25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:43:54.113715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.114617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b1d2380e-1341-4d84-b976-4d6c449ecf70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.117702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 827/1651] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:43:53 2022] DELETE /identity/v3/projects/83a4b9108dfb44708ec870a416c8a25f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:54.125202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d6a4-1702-459c-9630-cabf45fad29d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:54.125926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d6a4-1702-459c-9630-cabf45fad29d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:54.125926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d6a4-1702-459c-9630-cabf45fad29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:54.163145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4347d6a4-1702-459c-9630-cabf45fad29d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:54.164605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4347d6a4-1702-459c-9630-cabf45fad29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:54.391147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 825/1652] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:54.395402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5954a0-8ad2-45ad-9e42-d48c15dbfa96 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:54.395970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5954a0-8ad2-45ad-9e42-d48c15dbfa96 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:54.396252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5954a0-8ad2-45ad-9e42-d48c15dbfa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:54.440762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7d5954a0-8ad2-45ad-9e42-d48c15dbfa96 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:54.445902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7d5954a0-8ad2-45ad-9e42-d48c15dbfa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:54.473863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 828/1653] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:54.479829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347d6a4-1702-459c-9630-cabf45fad29d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:54.527088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347d6a4-1702-459c-9630-cabf45fad29d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:54.536231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:54.537492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:54.538651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:54.539172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:54.544123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:54.548173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:54.576319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:54.589929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5954a0-8ad2-45ad-9e42-d48c15dbfa96 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:54.592550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7d5954a0-8ad2-45ad-9e42-d48c15dbfa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:54.641777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5954a0-8ad2-45ad-9e42-d48c15dbfa96 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:54.650244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 826/1654] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:54.655241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:54.660150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:54.664691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:54.666187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:54.666969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] PATH_INFO: `/v3/projects/d4490cb75d5c4967b11f8d86175d4bfc` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:54.671759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4490cb75d5c4967b11f8d86175d4bfc)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:54.674975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:54.686269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04fb69-a225-4a42-8487-6d2f4e195ea7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:54.703652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40d848-cb2e-4683-bd26-b9c959e19990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:54.705365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40d848-cb2e-4683-bd26-b9c959e19990 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:54.705958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40d848-cb2e-4683-bd26-b9c959e19990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:54.706519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40d848-cb2e-4683-bd26-b9c959e19990 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:54.708923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40d848-cb2e-4683-bd26-b9c959e19990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:54.714371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40d848-cb2e-4683-bd26-b9c959e19990 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:54.812126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:54.821236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 827/1655] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:54 2022] POST /identity/v3/projects => generated 401 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:54.823232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40d848-cb2e-4683-bd26-b9c959e19990 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:54.824236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4490cb75d5c4967b11f8d86175d4bfc', 'request_id': 'req-b45c5bdf-c113-4c66-8fbe-c69a0565442c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.837295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4490cb75d5c4967b11f8d86175d4bfc', 'request_id': 'req-b45c5bdf-c113-4c66-8fbe-c69a0565442c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.857951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4490cb75d5c4967b11f8d86175d4bfc', 'request_id': 'req-b45c5bdf-c113-4c66-8fbe-c69a0565442c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.911493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] The token cache is being invalidate because project d4490cb75d5c4967b11f8d86175d4bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:43:54.912667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.913809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:54.923399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 829/1656] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:43:54 2022] DELETE /identity/v3/projects/d4490cb75d5c4967b11f8d86175d4bfc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:54.924708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:54.933518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:55.061304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40d848-cb2e-4683-bd26-b9c959e19990 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:55.074198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:55.074877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:55.075150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:55.075417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:55.076070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:55.080821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:55.121960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c5bdf-c113-4c66-8fbe-c69a0565442c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:55.195661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 828/1657] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:54 2022] POST /identity/v3/users => generated 301 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:55.198465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:55.199779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:55.200805 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:55.201701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:55.202577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] PATH_INFO: `/v3/users/7ce51826038b482cbc4efe671475172f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:55.204217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:55.229558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce51826038b482cbc4efe671475172f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:55.233523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:55.276778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd39b3-6cf9-479d-b606-ec2c12d133b9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:55.303658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6448c-8a4a-4b19-bffc-1684d2ce3b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:55.304945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6448c-8a4a-4b19-bffc-1684d2ce3b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:55.305741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6448c-8a4a-4b19-bffc-1684d2ce3b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:55.306464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6448c-8a4a-4b19-bffc-1684d2ce3b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:55.308267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6448c-8a4a-4b19-bffc-1684d2ce3b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:55.311499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6448c-8a4a-4b19-bffc-1684d2ce3b60 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:55.355888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 829/1658] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:55.365353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6448c-8a4a-4b19-bffc-1684d2ce3b60 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:55.397681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6448c-8a4a-4b19-bffc-1684d2ce3b60 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:55.418923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce51826038b482cbc4efe671475172f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:55.432111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:55.447788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:55.464327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:55.467303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:55.475268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:55.490711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:55.505136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce51826038b482cbc4efe671475172f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:55.527961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce51826038b482cbc4efe671475172f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:55.535228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce51826038b482cbc4efe671475172f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:55.535917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-39d8465f-7fd9-4d26-a950-73dfdbc6850d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce51826038b482cbc4efe671475172f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:55.618851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 830/1659] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:55.622843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:55.625263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 830/1660] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:43:54 2022] DELETE /identity/v3/users/7ce51826038b482cbc4efe671475172f => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:55.627807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:55.656228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2046b-3c18-43aa-b36b-6df43bc65015 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:55.664023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:55.963915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8c48-f3b6-4670-bf2e-8fcecb513998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:55.969851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8c48-f3b6-4670-bf2e-8fcecb513998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:55.970090 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8c48-f3b6-4670-bf2e-8fcecb513998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:55.970365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8c48-f3b6-4670-bf2e-8fcecb513998 admin admin] PATH_INFO: `/v3/projects/a3fbdcae7dd9487186184182de2d152a/users/442b7a49b93a4935b1983893572d79ea/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:56.036206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8c48-f3b6-4670-bf2e-8fcecb513998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fbdcae7dd9487186184182de2d152a, user_id=442b7a49b93a4935b1983893572d79ea, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:56.048080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8c48-f3b6-4670-bf2e-8fcecb513998 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:56.106310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 831/1661] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:55 2022] PUT /identity/v3/projects/a3fbdcae7dd9487186184182de2d152a/users/442b7a49b93a4935b1983893572d79ea/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:56.119722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3803-e32f-41b2-95f6-3bee3ca37eb3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:56.120290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3803-e32f-41b2-95f6-3bee3ca37eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:56.120474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3803-e32f-41b2-95f6-3bee3ca37eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:56.316075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4c5a3803-e32f-41b2-95f6-3bee3ca37eb3 None None] MFA Rules not processed for user `442b7a49b93a4935b1983893572d79ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:56.318100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c5a3803-e32f-41b2-95f6-3bee3ca37eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:56.606984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:56.677477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 831/1662] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:56.686246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8c48-f3b6-4670-bf2e-8fcecb513998 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:56.879231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a3803-e32f-41b2-95f6-3bee3ca37eb3 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:56.881742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c5a3803-e32f-41b2-95f6-3bee3ca37eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:56.948204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8c48-f3b6-4670-bf2e-8fcecb513998 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:56.975459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a3803-e32f-41b2-95f6-3bee3ca37eb3 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:56.994842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109629d-58c6-4dea-a348-ea7692e4d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:56.997964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109629d-58c6-4dea-a348-ea7692e4d66d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:57.000136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109629d-58c6-4dea-a348-ea7692e4d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:57.003087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109629d-58c6-4dea-a348-ea7692e4d66d admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:57.004430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109629d-58c6-4dea-a348-ea7692e4d66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:57.009549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:57.011194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:57.014658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109629d-58c6-4dea-a348-ea7692e4d66d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:57.017310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:57.017917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] PATH_INFO: `/v3/projects/5f47f8b406d7477eadc7f85d58e5b88d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:57.022060 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f47f8b406d7477eadc7f85d58e5b88d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:57.030661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:57.108866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 832/1663] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:56 2022] POST /identity/v3/projects => generated 405 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:57.111438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109629d-58c6-4dea-a348-ea7692e4d66d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:57.251523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f47f8b406d7477eadc7f85d58e5b88d', 'request_id': 'req-e39237d1-1dbe-4777-80ba-03e51c5bed79'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:57.284997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109629d-58c6-4dea-a348-ea7692e4d66d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:57.305554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f47f8b406d7477eadc7f85d58e5b88d', 'request_id': 'req-e39237d1-1dbe-4777-80ba-03e51c5bed79'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:57.333504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:57.341935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f47f8b406d7477eadc7f85d58e5b88d', 'request_id': 'req-e39237d1-1dbe-4777-80ba-03e51c5bed79'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:57.388703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] The token cache is being invalidate because project 5f47f8b406d7477eadc7f85d58e5b88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:43:57.394109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:57.398162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e39237d1-1dbe-4777-80ba-03e51c5bed79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:43:57.404361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 832/1664] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:43:56 2022] DELETE /identity/v3/projects/5f47f8b406d7477eadc7f85d58e5b88d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:57.410879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323dc21-07a0-473a-9cbd-f2790eda9a90 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:57.415208 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323dc21-07a0-473a-9cbd-f2790eda9a90 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:57.417585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323dc21-07a0-473a-9cbd-f2790eda9a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:57.482643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2323dc21-07a0-473a-9cbd-f2790eda9a90 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:57.483922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2323dc21-07a0-473a-9cbd-f2790eda9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:57.528819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:57.529503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:57.529813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:57.530117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:57.530870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:57.544256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:57.622996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 833/1665] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:57 2022] POST /identity/v3/users => generated 309 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:43:57.627472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:57.629683 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:57.655597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf831b34-2aec-4748-9e9b-f95ded574b0d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:57.671651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac189e76-c6fa-43fd-adc4-0a5dfbe23634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:57.672496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189e76-c6fa-43fd-adc4-0a5dfbe23634 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:57.672940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189e76-c6fa-43fd-adc4-0a5dfbe23634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:57.673364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac189e76-c6fa-43fd-adc4-0a5dfbe23634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:57.674055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac189e76-c6fa-43fd-adc4-0a5dfbe23634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:57.675764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac189e76-c6fa-43fd-adc4-0a5dfbe23634 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:57.692011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 833/1666] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:57.702913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 834/1667] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:43:57.704587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323dc21-07a0-473a-9cbd-f2790eda9a90 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:57.709200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1737-044f-47a4-abce-5223095d06b9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:57.709619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1737-044f-47a4-abce-5223095d06b9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:57.710045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1737-044f-47a4-abce-5223095d06b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:57.722127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323dc21-07a0-473a-9cbd-f2790eda9a90 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:57.742558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe2b1-419e-4ab8-9c10-c0a8fad1c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:57.761728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-114d1737-044f-47a4-abce-5223095d06b9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:57.763249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-114d1737-044f-47a4-abce-5223095d06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:57.768558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe2b1-419e-4ab8-9c10-c0a8fad1c6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:57.769297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe2b1-419e-4ab8-9c10-c0a8fad1c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:57.769697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe2b1-419e-4ab8-9c10-c0a8fad1c6a8 admin admin] PATH_INFO: `/v3/projects/d308152d77b749fba434be3f4ad96811/users/1f0d1cacb80e4394829f1224c289cfd2/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:57.784449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 835/1668] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:57.790414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1737-044f-47a4-abce-5223095d06b9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:57.807194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1737-044f-47a4-abce-5223095d06b9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:57.818539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbe2b1-419e-4ab8-9c10-c0a8fad1c6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d308152d77b749fba434be3f4ad96811, user_id=1f0d1cacb80e4394829f1224c289cfd2, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:57.824405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:57.825319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:57.825758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:57.825875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbe2b1-419e-4ab8-9c10-c0a8fad1c6a8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:57.826266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:57.827431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:43:57.827909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:57.829715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:57.866126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 836/1669] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:43:57.871371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:57.890950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 834/1670] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:57 2022] PUT /identity/v3/projects/d308152d77b749fba434be3f4ad96811/users/1f0d1cacb80e4394829f1224c289cfd2/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:57.894143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe2b1-419e-4ab8-9c10-c0a8fad1c6a8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:57.895657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141d692-3447-4071-8ae9-7ed48fe539c0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:58.049106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:58.109532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559d67-b3db-438a-bade-812cc35cf19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:58.110832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559d67-b3db-438a-bade-812cc35cf19d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.111121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559d67-b3db-438a-bade-812cc35cf19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.114727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559d67-b3db-438a-bade-812cc35cf19d admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.115612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7559d67-b3db-438a-bade-812cc35cf19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:58.125293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7559d67-b3db-438a-bade-812cc35cf19d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:58.131329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe2b1-419e-4ab8-9c10-c0a8fad1c6a8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:58.160763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527f404-88ad-4cb5-84d1-570ed9b59e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:58.161424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527f404-88ad-4cb5-84d1-570ed9b59e62 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.161705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527f404-88ad-4cb5-84d1-570ed9b59e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.161995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527f404-88ad-4cb5-84d1-570ed9b59e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.162719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527f404-88ad-4cb5-84d1-570ed9b59e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:58.164474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527f404-88ad-4cb5-84d1-570ed9b59e62 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:58.224574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 835/1671] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:58.225336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527f404-88ad-4cb5-84d1-570ed9b59e62 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:58.234657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 837/1672] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:57 2022] POST /identity/v3/projects => generated 375 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:43:58.237888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559d67-b3db-438a-bade-812cc35cf19d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:58.250553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527f404-88ad-4cb5-84d1-570ed9b59e62 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:58.381496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559d67-b3db-438a-bade-812cc35cf19d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:58.399255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93278c-aa08-4669-a832-0bd9dee0b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:58.400815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93278c-aa08-4669-a832-0bd9dee0b088 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.401687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93278c-aa08-4669-a832-0bd9dee0b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.402112 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93278c-aa08-4669-a832-0bd9dee0b088 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.404366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93278c-aa08-4669-a832-0bd9dee0b088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:58.426162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93278c-aa08-4669-a832-0bd9dee0b088 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:58.440553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:58.466286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 838/1673] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:58 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:43:58.467997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed6660-b6b2-4eea-96bb-d40f8f52050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:58.468782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6660-b6b2-4eea-96bb-d40f8f52050a admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.469258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6660-b6b2-4eea-96bb-d40f8f52050a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.470444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93278c-aa08-4669-a832-0bd9dee0b088 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:58.471518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6660-b6b2-4eea-96bb-d40f8f52050a admin admin] PATH_INFO: `/v3/projects/d308152d77b749fba434be3f4ad96811/users/1f0d1cacb80e4394829f1224c289cfd2/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.479580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed6660-b6b2-4eea-96bb-d40f8f52050a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d308152d77b749fba434be3f4ad96811, user_id=1f0d1cacb80e4394829f1224c289cfd2, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:58.493750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed6660-b6b2-4eea-96bb-d40f8f52050a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:58.509572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93278c-aa08-4669-a832-0bd9dee0b088 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:58.522558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 836/1674] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:58 2022] PUT /identity/v3/projects/d308152d77b749fba434be3f4ad96811/users/1f0d1cacb80e4394829f1224c289cfd2/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:58.532135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e2dd9-3cbc-4af7-abe1-209c6327edb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:58.533214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e2dd9-3cbc-4af7-abe1-209c6327edb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.535534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e2dd9-3cbc-4af7-abe1-209c6327edb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.536548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e2dd9-3cbc-4af7-abe1-209c6327edb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.537285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e2dd9-3cbc-4af7-abe1-209c6327edb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:58.540078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeff01-6bda-4317-815b-3109dfbfbe18 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.541637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeff01-6bda-4317-815b-3109dfbfbe18 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.544908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeff01-6bda-4317-815b-3109dfbfbe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.549939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e2dd9-3cbc-4af7-abe1-209c6327edb2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:58.577224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 839/1675] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:43:58.580330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e2dd9-3cbc-4af7-abe1-209c6327edb2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:58.608379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e2dd9-3cbc-4af7-abe1-209c6327edb2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:58.668375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-16eeff01-6bda-4317-815b-3109dfbfbe18 None None] MFA Rules not processed for user `1f0d1cacb80e4394829f1224c289cfd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:58.669956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-16eeff01-6bda-4317-815b-3109dfbfbe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:58.756543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da12ce-e56e-44fc-b29b-aef0f6be6edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:58.759817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da12ce-e56e-44fc-b29b-aef0f6be6edc admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.760570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da12ce-e56e-44fc-b29b-aef0f6be6edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.761089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da12ce-e56e-44fc-b29b-aef0f6be6edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.762168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da12ce-e56e-44fc-b29b-aef0f6be6edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:58.764521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da12ce-e56e-44fc-b29b-aef0f6be6edc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:58.783073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 840/1676] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:43:58.791015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da12ce-e56e-44fc-b29b-aef0f6be6edc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:58.826400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da12ce-e56e-44fc-b29b-aef0f6be6edc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:58.843754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2770e9-2103-4509-9cd2-86ded477671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:58.844375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2770e9-2103-4509-9cd2-86ded477671a admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.844651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2770e9-2103-4509-9cd2-86ded477671a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.844923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2770e9-2103-4509-9cd2-86ded477671a admin admin] PATH_INFO: `/v3/projects/5cd6728de69f4473a3889d3ca96f9696/users/20b4e19b7ce34551bab0d2822ec9d279/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.879300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2770e9-2103-4509-9cd2-86ded477671a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd6728de69f4473a3889d3ca96f9696, user_id=20b4e19b7ce34551bab0d2822ec9d279, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:58.886204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2770e9-2103-4509-9cd2-86ded477671a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:58.915130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 841/1677] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:58 2022] PUT /identity/v3/projects/5cd6728de69f4473a3889d3ca96f9696/users/20b4e19b7ce34551bab0d2822ec9d279/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:43:58.924643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 837/1678] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:58.929894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277193-c54d-4177-aca2-5754ad648c9c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:58.930176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277193-c54d-4177-aca2-5754ad648c9c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:58.930461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277193-c54d-4177-aca2-5754ad648c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:58.933996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeff01-6bda-4317-815b-3109dfbfbe18 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:58.936340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-16eeff01-6bda-4317-815b-3109dfbfbe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:59.009523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-95277193-c54d-4177-aca2-5754ad648c9c None None] MFA Rules not processed for user `20b4e19b7ce34551bab0d2822ec9d279`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:43:59.010842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-95277193-c54d-4177-aca2-5754ad648c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:43:59.183708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeff01-6bda-4317-815b-3109dfbfbe18 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:59.199542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 842/1679] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:43:59.201578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277193-c54d-4177-aca2-5754ad648c9c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:59.231927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:59.429772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:59.447276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ba009-85f9-4300-b883-97cae896d122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:59.449230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba009-85f9-4300-b883-97cae896d122 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:59.449518 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba009-85f9-4300-b883-97cae896d122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:59.449799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba009-85f9-4300-b883-97cae896d122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:59.482297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277193-c54d-4177-aca2-5754ad648c9c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:59.507749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce897bd3-e7eb-4dbb-b860-57a2ac804b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:59.508491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897bd3-e7eb-4dbb-b860-57a2ac804b15 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:59.508788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897bd3-e7eb-4dbb-b860-57a2ac804b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:59.512893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897bd3-e7eb-4dbb-b860-57a2ac804b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:59.514144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce897bd3-e7eb-4dbb-b860-57a2ac804b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:59.516601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce897bd3-e7eb-4dbb-b860-57a2ac804b15 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:59.578431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 843/1680] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:43:59 2022] POST /identity/v3/projects => generated 375 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:43:59.581228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce897bd3-e7eb-4dbb-b860-57a2ac804b15 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:59.605863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ba009-85f9-4300-b883-97cae896d122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:59.607357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ba009-85f9-4300-b883-97cae896d122 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:59.637539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 838/1681] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:43:58 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:43:59.801103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce897bd3-e7eb-4dbb-b860-57a2ac804b15 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:59.820300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddff921-b807-43b9-a48f-223d0ad36d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:59.821461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddff921-b807-43b9-a48f-223d0ad36d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:59.821950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddff921-b807-43b9-a48f-223d0ad36d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:59.822243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddff921-b807-43b9-a48f-223d0ad36d17 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:59.823348 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddff921-b807-43b9-a48f-223d0ad36d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:59.826111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddff921-b807-43b9-a48f-223d0ad36d17 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:59.861846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ba009-85f9-4300-b883-97cae896d122 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:59.888385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ba009-85f9-4300-b883-97cae896d122 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:59.899729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:59.901704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:59.902170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:59.902942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] PATH_INFO: `/v3/users/442b7a49b93a4935b1983893572d79ea` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:59.906043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442b7a49b93a4935b1983893572d79ea)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:59.908283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:59.928209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 844/1682] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:43:59 2022] POST /identity/v3/users => generated 294 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:43:59.935675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddff921-b807-43b9-a48f-223d0ad36d17 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:43:59.951835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddff921-b807-43b9-a48f-223d0ad36d17 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:43:59.962598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116cb8f-2f16-4213-a5b1-7e459097142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:43:59.963835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116cb8f-2f16-4213-a5b1-7e459097142b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:43:59.965425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116cb8f-2f16-4213-a5b1-7e459097142b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:43:59.966402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116cb8f-2f16-4213-a5b1-7e459097142b admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:43:59.967939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116cb8f-2f16-4213-a5b1-7e459097142b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:43:59.972196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116cb8f-2f16-4213-a5b1-7e459097142b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:43:59.991170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 845/1683] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:44:00.000546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116cb8f-2f16-4213-a5b1-7e459097142b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:00.020535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442b7a49b93a4935b1983893572d79ea'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:00.032406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116cb8f-2f16-4213-a5b1-7e459097142b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:00.044628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:00.045437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:00.046119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:00.046447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] PATH_INFO: `/v3/projects/e6b2842030564571acb57b74280e38c5/users/b479d07c57954501a20fea6e0b847c26/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:00.056881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442b7a49b93a4935b1983893572d79ea'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:00.075449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442b7a49b93a4935b1983893572d79ea'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:00.076225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442b7a49b93a4935b1983893572d79ea'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:00.076985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c18e3605-e01f-4b8c-a73c-945fca750b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442b7a49b93a4935b1983893572d79ea'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:00.088664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b2842030564571acb57b74280e38c5, user_id=b479d07c57954501a20fea6e0b847c26, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:00.092468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:00.105827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 839/1684] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:43:59 2022] DELETE /identity/v3/users/442b7a49b93a4935b1983893572d79ea => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:00.111795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19cc67-72c8-4452-9523-97481c2fceab None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:00.111795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19cc67-72c8-4452-9523-97481c2fceab None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:00.111795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19cc67-72c8-4452-9523-97481c2fceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:00.129013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 846/1685] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:43:59 2022] PUT /identity/v3/projects/e6b2842030564571acb57b74280e38c5/users/b479d07c57954501a20fea6e0b847c26/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:00.137950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:00.141344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:00.155602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2e19cc67-72c8-4452-9523-97481c2fceab None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:00.157018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2e19cc67-72c8-4452-9523-97481c2fceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:00.209993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:00.271024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 840/1686] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:00.333728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19cc67-72c8-4452-9523-97481c2fceab None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:00.337162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2e19cc67-72c8-4452-9523-97481c2fceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:00.382782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bdea1-e005-4adc-80d3-66018f9e53c5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:00.399426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e16d06-3345-4e61-aaa1-1c6b1804302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:00.429560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16d06-3345-4e61-aaa1-1c6b1804302c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:00.430599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16d06-3345-4e61-aaa1-1c6b1804302c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:00.432869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16d06-3345-4e61-aaa1-1c6b1804302c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:00.435099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e16d06-3345-4e61-aaa1-1c6b1804302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:00.440166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e16d06-3345-4e61-aaa1-1c6b1804302c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:00.476751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 847/1687] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:00.477981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e16d06-3345-4e61-aaa1-1c6b1804302c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:00.512753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e16d06-3345-4e61-aaa1-1c6b1804302c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:00.530784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6d4e7-8339-45ef-b9bd-16ce260b710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:00.531692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d4e7-8339-45ef-b9bd-16ce260b710b admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:00.542637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d4e7-8339-45ef-b9bd-16ce260b710b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:00.543411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d4e7-8339-45ef-b9bd-16ce260b710b admin admin] PATH_INFO: `/v3/projects/e6b2842030564571acb57b74280e38c5/users/b479d07c57954501a20fea6e0b847c26/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:00.546703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6d4e7-8339-45ef-b9bd-16ce260b710b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b2842030564571acb57b74280e38c5, user_id=b479d07c57954501a20fea6e0b847c26, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:00.552885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6d4e7-8339-45ef-b9bd-16ce260b710b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:00.574676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19cc67-72c8-4452-9523-97481c2fceab None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:00.596807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 848/1688] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:00 2022] PUT /identity/v3/projects/e6b2842030564571acb57b74280e38c5/users/b479d07c57954501a20fea6e0b847c26/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:00.601131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13747c12-e542-4c4b-acf2-b60b560b59f0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:00.601569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13747c12-e542-4c4b-acf2-b60b560b59f0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:00.601922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13747c12-e542-4c4b-acf2-b60b560b59f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:00.612259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:00.613382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:00.621610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:00.636071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:00.636634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:00.679335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-13747c12-e542-4c4b-acf2-b60b560b59f0 None None] MFA Rules not processed for user `b479d07c57954501a20fea6e0b847c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:00.681020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-13747c12-e542-4c4b-acf2-b60b560b59f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:00.752726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:00.765434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:00.804826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 841/1689] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:01.017886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:01.022566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:01.075271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 849/1690] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:01.095165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13747c12-e542-4c4b-acf2-b60b560b59f0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:01.098307 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-13747c12-e542-4c4b-acf2-b60b560b59f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:01.139802 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f8229-cc57-4038-92f2-fa335b59af46 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:01.452623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:01.453866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:01.454879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:01.455629 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] PATH_INFO: `/v3/users/cd47e454e8be4469926d3783f78a18ad` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:01.460108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd47e454e8be4469926d3783f78a18ad)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:01.465455 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:01.491613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13747c12-e542-4c4b-acf2-b60b560b59f0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:01.513530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:01.514500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:01.515140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:01.515640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:01.525913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:01.656379 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd47e454e8be4469926d3783f78a18ad'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:01.706479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd47e454e8be4469926d3783f78a18ad'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:01.729066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd47e454e8be4469926d3783f78a18ad'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:01.731496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd47e454e8be4469926d3783f78a18ad'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:01.733818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7d83bffe-5942-46a9-bf98-33d15d494311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd47e454e8be4469926d3783f78a18ad'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:01.743734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:01.777287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 842/1691] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:01 2022] DELETE /identity/v3/users/cd47e454e8be4469926d3783f78a18ad => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:01.783474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a8972-18d3-4956-b5e8-b0390dba1d21 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:01.783813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a8972-18d3-4956-b5e8-b0390dba1d21 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:01.784146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a8972-18d3-4956-b5e8-b0390dba1d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:01.830401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:01.832891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-332a8972-18d3-4956-b5e8-b0390dba1d21 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:01.833328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:01.838635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-332a8972-18d3-4956-b5e8-b0390dba1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:01.865227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 850/1692] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:02.060704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 843/1693] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:02.085134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:02.089658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:02.298928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:02.347379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3017b44-4403-4799-b700-63c208b8cd87 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:02.599940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5442b-afd9-4917-96a2-a5a39294b45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:02.600716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5442b-afd9-4917-96a2-a5a39294b45d service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:02.600994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5442b-afd9-4917-96a2-a5a39294b45d service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:02.602079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5442b-afd9-4917-96a2-a5a39294b45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:02.636178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a8972-18d3-4956-b5e8-b0390dba1d21 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:02.639418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-332a8972-18d3-4956-b5e8-b0390dba1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:02.668859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5442b-afd9-4917-96a2-a5a39294b45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:02.670457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5442b-afd9-4917-96a2-a5a39294b45d service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:02.692141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 851/1694] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:02.702168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a8972-18d3-4956-b5e8-b0390dba1d21 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:02.723899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:02.725042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:02.725497 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:02.730025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] PATH_INFO: `/v3/users/e3fbb46762664c5d8ce9f4dfdbb5f4f8` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:02.739299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3fbb46762664c5d8ce9f4dfdbb5f4f8)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:02.748480 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:02.900720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d16c-c247-41c2-aafc-e045d7acb298 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:02.901117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d16c-c247-41c2-aafc-e045d7acb298 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:02.901256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d16c-c247-41c2-aafc-e045d7acb298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:02.906263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3fbb46762664c5d8ce9f4dfdbb5f4f8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:02.962369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3fbb46762664c5d8ce9f4dfdbb5f4f8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:03.005834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3fbb46762664c5d8ce9f4dfdbb5f4f8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:03.009293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3fbb46762664c5d8ce9f4dfdbb5f4f8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:03.012466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c1545c00-5c88-4f2b-a20d-a601e3aecd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3fbb46762664c5d8ce9f4dfdbb5f4f8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:03.013149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f304d16c-c247-41c2-aafc-e045d7acb298 None None] MFA Rules not processed for user `192a22cb876f4f72b09d5835b479f58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:03.017441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f304d16c-c247-41c2-aafc-e045d7acb298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:03.091912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 844/1695] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:02 2022] DELETE /identity/v3/users/e3fbb46762664c5d8ce9f4dfdbb5f4f8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:03.094719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5422fd-ca7e-47cf-98d6-b16fc6806ce6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:03.096096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5422fd-ca7e-47cf-98d6-b16fc6806ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:03.096096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5422fd-ca7e-47cf-98d6-b16fc6806ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:03.178087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fb5422fd-ca7e-47cf-98d6-b16fc6806ce6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:03.186483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fb5422fd-ca7e-47cf-98d6-b16fc6806ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:03.282413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 852/1696] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:03.306063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39604c49-8fa5-4448-ba3b-9beb378bb1d3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:03.306979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39604c49-8fa5-4448-ba3b-9beb378bb1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:03.307360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39604c49-8fa5-4448-ba3b-9beb378bb1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:03.354569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 845/1697] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:03.355674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-39604c49-8fa5-4448-ba3b-9beb378bb1d3 None None] MFA Rules not processed for user `192a22cb876f4f72b09d5835b479f58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:03.357136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-39604c49-8fa5-4448-ba3b-9beb378bb1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:03.455222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5422fd-ca7e-47cf-98d6-b16fc6806ce6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:03.458839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fb5422fd-ca7e-47cf-98d6-b16fc6806ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:03.495106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:03.531938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 853/1698] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:03.550953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39604c49-8fa5-4448-ba3b-9beb378bb1d3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:03.554340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-39604c49-8fa5-4448-ba3b-9beb378bb1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:03.771558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:03.782597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5422fd-ca7e-47cf-98d6-b16fc6806ce6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:03.798580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:03.799248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:03.799525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:03.799973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:03.833247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:03.837603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:03.869307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 846/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:03.897085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39604c49-8fa5-4448-ba3b-9beb378bb1d3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:03.913401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74bdd-4cd0-4271-b7a4-8859ee2c0614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:03.915274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74bdd-4cd0-4271-b7a4-8859ee2c0614 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:03.916775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74bdd-4cd0-4271-b7a4-8859ee2c0614 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:03.917077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74bdd-4cd0-4271-b7a4-8859ee2c0614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:03.939619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d74bdd-4cd0-4271-b7a4-8859ee2c0614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:03.943700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d74bdd-4cd0-4271-b7a4-8859ee2c0614 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:03.989820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 854/1700] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:04.196817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:04.198675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:04.227631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3351794-34b8-4619-826d-7ffe8c912018 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:04.266931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:04.267623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:04.267903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:04.268270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] PATH_INFO: `/v3/projects/a3fbdcae7dd9487186184182de2d152a` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:04.272452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fbdcae7dd9487186184182de2d152a)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:04.281873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:04.451976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fbdcae7dd9487186184182de2d152a', 'request_id': 'req-f86026c7-7713-4123-ac90-a480f01d2d61'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.471524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fbdcae7dd9487186184182de2d152a', 'request_id': 'req-f86026c7-7713-4123-ac90-a480f01d2d61'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.499529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fbdcae7dd9487186184182de2d152a', 'request_id': 'req-f86026c7-7713-4123-ac90-a480f01d2d61'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.531411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] The token cache is being invalidate because project a3fbdcae7dd9487186184182de2d152a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:04.531801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.534877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.536656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 847/1701] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:04 2022] DELETE /identity/v3/projects/a3fbdcae7dd9487186184182de2d152a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:04.541525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74bdd-4cd0-4271-b7a4-8859ee2c0614 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:04.568416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74bdd-4cd0-4271-b7a4-8859ee2c0614 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:04.717570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:04.718593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:04.719057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:04.719475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] PATH_INFO: `/v3/users/1f0d1cacb80e4394829f1224c289cfd2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:04.721348 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0d1cacb80e4394829f1224c289cfd2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:04.724155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:04.834107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0d1cacb80e4394829f1224c289cfd2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.855309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0d1cacb80e4394829f1224c289cfd2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.856759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0d1cacb80e4394829f1224c289cfd2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.857947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0d1cacb80e4394829f1224c289cfd2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.871240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0d1cacb80e4394829f1224c289cfd2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:04.896445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 855/1702] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:04 2022] DELETE /identity/v3/users/1f0d1cacb80e4394829f1224c289cfd2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:04.965717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:04.968173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:04.994021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86026c7-7713-4123-ac90-a480f01d2d61 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:05.208747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:05.209474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:05.209753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:05.210025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] PATH_INFO: `/v3/projects/464590c74fa44fd49477a80465f18a63` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:05.212552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=464590c74fa44fd49477a80465f18a63)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:05.215449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:05.327849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:05.365879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464590c74fa44fd49477a80465f18a63', 'request_id': 'req-460a586d-c6fd-4f43-a678-9967db540b26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.398468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464590c74fa44fd49477a80465f18a63', 'request_id': 'req-460a586d-c6fd-4f43-a678-9967db540b26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.428422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464590c74fa44fd49477a80465f18a63', 'request_id': 'req-460a586d-c6fd-4f43-a678-9967db540b26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.468296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] The token cache is being invalidate because project 464590c74fa44fd49477a80465f18a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:05.471516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.476931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.484486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 848/1703] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:04 2022] DELETE /identity/v3/projects/464590c74fa44fd49477a80465f18a63 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:05.489324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:05.493450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:05.544810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bdc25-b89e-4e77-927a-ce57bc5feef7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:05.617239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:05.620341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:05.740225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:05.779717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:05.780416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:05.780696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:05.783200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] PATH_INFO: `/v3/users/a56a9e954b6a48c6bd1a8afce888ac76` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:05.790176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56a9e954b6a48c6bd1a8afce888ac76)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:05.792338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:05.854319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a586d-c6fd-4f43-a678-9967db540b26 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:05.868457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacf498-c8bb-467d-94db-d49534919301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:05.869338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf498-c8bb-467d-94db-d49534919301 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:05.869629 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf498-c8bb-467d-94db-d49534919301 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:05.870229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacf498-c8bb-467d-94db-d49534919301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:05.877220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3bacf498-c8bb-467d-94db-d49534919301 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:05.896608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56a9e954b6a48c6bd1a8afce888ac76'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.945986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56a9e954b6a48c6bd1a8afce888ac76'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.948789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56a9e954b6a48c6bd1a8afce888ac76'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.953171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56a9e954b6a48c6bd1a8afce888ac76'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:05.989479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9945e5c6-7fe4-43c7-ad8d-0b617f1b28ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56a9e954b6a48c6bd1a8afce888ac76'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:06.034527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 856/1704] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:05 2022] DELETE /identity/v3/users/a56a9e954b6a48c6bd1a8afce888ac76 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:06.069217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf498-c8bb-467d-94db-d49534919301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:06.074819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacf498-c8bb-467d-94db-d49534919301 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:06.102135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 849/1705] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:06.424399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3af8-84cf-45be-aab8-909ecffe3242 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:06.424399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3af8-84cf-45be-aab8-909ecffe3242 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:06.424751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3af8-84cf-45be-aab8-909ecffe3242 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:06.426577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 857/1706] 10.222.0.49 () {54 vars in 912 bytes} [Tue Aug 30 14:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:44:06.444909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192bfe-710d-4286-9e70-68b69f8f9b77 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:06.445219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192bfe-710d-4286-9e70-68b69f8f9b77 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:06.445709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65192bfe-710d-4286-9e70-68b69f8f9b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:06.608236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-65192bfe-710d-4286-9e70-68b69f8f9b77 None None] MFA Rules not processed for user `6b24f12951bd4220afad25f23f566f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:06.610486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-65192bfe-710d-4286-9e70-68b69f8f9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:06.891757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 850/1707] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:06.974347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3af8-84cf-45be-aab8-909ecffe3242 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:06.976879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-202b3af8-84cf-45be-aab8-909ecffe3242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:07.017762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3af8-84cf-45be-aab8-909ecffe3242 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:07.033166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022859b-8aee-4813-a3c7-9a031c3a65ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:07.033874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022859b-8aee-4813-a3c7-9a031c3a65ee service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:07.034156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022859b-8aee-4813-a3c7-9a031c3a65ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:07.034476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022859b-8aee-4813-a3c7-9a031c3a65ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:07.066524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022859b-8aee-4813-a3c7-9a031c3a65ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:07.076305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022859b-8aee-4813-a3c7-9a031c3a65ee service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:07.096152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 858/1708] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:07.348653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192bfe-710d-4286-9e70-68b69f8f9b77 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:07.353188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-65192bfe-710d-4286-9e70-68b69f8f9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:07.402197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:07.636075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65192bfe-710d-4286-9e70-68b69f8f9b77 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:07.651176 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:07.652618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:07.655399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:07.656929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] PATH_INFO: `/v3/projects/41d41206e0c04b379175e6481ad4f90a` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:07.661136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d41206e0c04b379175e6481ad4f90a)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:07.669099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:07.857893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d41206e0c04b379175e6481ad4f90a', 'request_id': 'req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:07.886826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d41206e0c04b379175e6481ad4f90a', 'request_id': 'req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:07.914897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d41206e0c04b379175e6481ad4f90a', 'request_id': 'req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:07.956777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] The token cache is being invalidate because project 41d41206e0c04b379175e6481ad4f90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:07.957753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:07.958503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bb96efff-ab7e-4c87-8fae-ba750c4fa9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:07.966869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 851/1709] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:07 2022] DELETE /identity/v3/projects/41d41206e0c04b379175e6481ad4f90a => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:07.969020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13772-a4ca-4a84-8bd9-d41cedf8f494 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:07.969310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13772-a4ca-4a84-8bd9-d41cedf8f494 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:07.969669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d13772-a4ca-4a84-8bd9-d41cedf8f494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:08.027358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c9d13772-a4ca-4a84-8bd9-d41cedf8f494 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:08.030419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c9d13772-a4ca-4a84-8bd9-d41cedf8f494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:08.337358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 859/1710] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:08.338485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560f6c-a364-4377-b87c-ec95401e7781 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:08.339115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560f6c-a364-4377-b87c-ec95401e7781 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:08.339712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560f6c-a364-4377-b87c-ec95401e7781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:08.423660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fa560f6c-a364-4377-b87c-ec95401e7781 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:08.436337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fa560f6c-a364-4377-b87c-ec95401e7781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:08.476046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 852/1711] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:08.478222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d13772-a4ca-4a84-8bd9-d41cedf8f494 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:08.515454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d13772-a4ca-4a84-8bd9-d41cedf8f494 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:08.544948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:08.545608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:08.545890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:08.546164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:08.546906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:08.547212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:08.554442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:08.641894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 860/1712] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:44:08.645411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa560f6c-a364-4377-b87c-ec95401e7781 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:08.660222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa560f6c-a364-4377-b87c-ec95401e7781 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:08.677166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:08.679088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:08.679373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:08.680834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:08.683487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:08.688713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:08.771902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 853/1713] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:08 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:44:08.777266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:08.793065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581b49-4675-4e44-8a6d-0f2fa7f1f498 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:08.894695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:08.911039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:08.917694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:08.999295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaa400-292d-4a09-90ef-df588572c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:09.000483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaa400-292d-4a09-90ef-df588572c715 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:09.001790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaa400-292d-4a09-90ef-df588572c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:09.002478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaa400-292d-4a09-90ef-df588572c715 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:09.003321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaa400-292d-4a09-90ef-df588572c715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:09.010828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaa400-292d-4a09-90ef-df588572c715 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:09.107707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 861/1714] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:08 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:09.136765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaa400-292d-4a09-90ef-df588572c715 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:09.265779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaa400-292d-4a09-90ef-df588572c715 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:09.303823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:09.304294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:09.304703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:09.305412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:09.322672 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:09.332538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9629e-eaf3-4b9f-a923-005649acdecb admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:09.333084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:09.352862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:09.355421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:09.358536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:09.360404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] PATH_INFO: `/v3/projects/d308152d77b749fba434be3f4ad96811` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:09.362134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d308152d77b749fba434be3f4ad96811)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:09.370435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:09.430494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:09.431638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 862/1715] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:09.435153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:09.449039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:09.514335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd308152d77b749fba434be3f4ad96811', 'request_id': 'req-49875bac-e89b-468e-9b47-d187b463e44b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:09.528690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd308152d77b749fba434be3f4ad96811', 'request_id': 'req-49875bac-e89b-468e-9b47-d187b463e44b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:09.547949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd308152d77b749fba434be3f4ad96811', 'request_id': 'req-49875bac-e89b-468e-9b47-d187b463e44b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:09.574935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] The token cache is being invalidate because project d308152d77b749fba434be3f4ad96811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:09.575645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:09.576736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:09.578953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 854/1716] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:08 2022] DELETE /identity/v3/projects/d308152d77b749fba434be3f4ad96811 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:09.580174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:09.589701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:09.651775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac878-988e-41e7-8ede-c6da8a4d44f5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:09.803848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358be78-bbd4-40d0-a227-ab8ea5135772 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:09.804655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358be78-bbd4-40d0-a227-ab8ea5135772 service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:09.804969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358be78-bbd4-40d0-a227-ab8ea5135772 service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:09.805247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358be78-bbd4-40d0-a227-ab8ea5135772 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:09.811685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6358be78-bbd4-40d0-a227-ab8ea5135772 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:09.838369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49875bac-e89b-468e-9b47-d187b463e44b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:09.842487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358be78-bbd4-40d0-a227-ab8ea5135772 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:09.844132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358be78-bbd4-40d0-a227-ab8ea5135772 service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:09.865596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde680-6c07-4da7-87ed-53b90b5161fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:09.866548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde680-6c07-4da7-87ed-53b90b5161fc admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:09.867836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde680-6c07-4da7-87ed-53b90b5161fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:09.868222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde680-6c07-4da7-87ed-53b90b5161fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:09.869747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fde680-6c07-4da7-87ed-53b90b5161fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:09.870444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 863/1717] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:09.872009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1912d5-b4b9-419f-9f20-b50bad7edd57 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:09.872217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1912d5-b4b9-419f-9f20-b50bad7edd57 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:09.872474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1912d5-b4b9-419f-9f20-b50bad7edd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:09.876338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fde680-6c07-4da7-87ed-53b90b5161fc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:09.912055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 855/1718] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:09.917549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde680-6c07-4da7-87ed-53b90b5161fc admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:09.928542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3b1912d5-b4b9-419f-9f20-b50bad7edd57 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:09.929877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3b1912d5-b4b9-419f-9f20-b50bad7edd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:09.949008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 864/1719] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:09.957484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58590f9-39e9-4373-aab4-5d8b10984dcb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:09.957846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58590f9-39e9-4373-aab4-5d8b10984dcb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:09.958137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58590f9-39e9-4373-aab4-5d8b10984dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:09.972048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde680-6c07-4da7-87ed-53b90b5161fc admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:10.007304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e58590f9-39e9-4373-aab4-5d8b10984dcb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:10.008720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e58590f9-39e9-4373-aab4-5d8b10984dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:10.024819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:10.027233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 865/1720] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:10.028591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:10.029083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:10.029570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] PATH_INFO: `/v3/projects/4f88928b864f422d96625acf2564f052/users/c3c6fc52171343a9a9b29f57ea2c41e1/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:10.031585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58590f9-39e9-4373-aab4-5d8b10984dcb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:10.058176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58590f9-39e9-4373-aab4-5d8b10984dcb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:10.064713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:10.065351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:10.065632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:10.065904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:10.066602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:10.067058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:10.076583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:10.103532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 866/1721] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:44:10.104593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:10.135556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f88928b864f422d96625acf2564f052, user_id=c3c6fc52171343a9a9b29f57ea2c41e1, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:10.137651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:10.141146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb445-6e5c-4abc-a7b4-b2e4b5a7076d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:10.159196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24d79c-1e8c-4b11-873b-23d1e35c1d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:10.159972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24d79c-1e8c-4b11-873b-23d1e35c1d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:10.160328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24d79c-1e8c-4b11-873b-23d1e35c1d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:10.161020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24d79c-1e8c-4b11-873b-23d1e35c1d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:10.161875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24d79c-1e8c-4b11-873b-23d1e35c1d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:10.163996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24d79c-1e8c-4b11-873b-23d1e35c1d33 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:10.181667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 856/1722] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:09 2022] PUT /identity/v3/projects/4f88928b864f422d96625acf2564f052/users/c3c6fc52171343a9a9b29f57ea2c41e1/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:10.182659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:10.186199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:10.246852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:10.265414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 867/1723] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:10 2022] POST /identity/v3/projects => generated 399 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:10.270762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d395-310e-4704-9ee4-54aee21e29d9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:10.270762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d395-310e-4704-9ee4-54aee21e29d9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:10.270985 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d395-310e-4704-9ee4-54aee21e29d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:10.370275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-36c8d395-310e-4704-9ee4-54aee21e29d9 None None] MFA Rules not processed for user `c3c6fc52171343a9a9b29f57ea2c41e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:10.372506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-36c8d395-310e-4704-9ee4-54aee21e29d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:10.401439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f261d8a-62bc-4e88-bf51-8d582b57def1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:10.461032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:10.574178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 868/1724] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:10.574178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651c155-66a5-4258-acb6-6da5086493d7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:10.574178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651c155-66a5-4258-acb6-6da5086493d7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:10.574178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651c155-66a5-4258-acb6-6da5086493d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:10.649946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:10.651201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:10.652063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:10.652681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f651c155-66a5-4258-acb6-6da5086493d7 None None] MFA Rules not processed for user `5b64acf3f19a40ca869bf9070bad361b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:10.653111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] PATH_INFO: `/v3/projects/3d44a5d46850456d9030ca7db8478da5` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:10.654975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f651c155-66a5-4258-acb6-6da5086493d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:10.656489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d44a5d46850456d9030ca7db8478da5)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:10.690399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:10.832327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d44a5d46850456d9030ca7db8478da5', 'request_id': 'req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:10.858231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d44a5d46850456d9030ca7db8478da5', 'request_id': 'req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:10.879827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 869/1725] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:10.879827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651c155-66a5-4258-acb6-6da5086493d7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:10.882796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d44a5d46850456d9030ca7db8478da5', 'request_id': 'req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:10.912259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651c155-66a5-4258-acb6-6da5086493d7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:10.949561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] The token cache is being invalidate because project 3d44a5d46850456d9030ca7db8478da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:10.951610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:10.954116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-482d6ce5-0c78-42c8-8c13-78e9604d0c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:10.958934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 857/1726] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:10 2022] DELETE /identity/v3/projects/3d44a5d46850456d9030ca7db8478da5 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:10.970447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546aa3d-62c5-4e85-887e-0f933734bd5e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:10.970940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546aa3d-62c5-4e85-887e-0f933734bd5e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:10.971340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546aa3d-62c5-4e85-887e-0f933734bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:11.044071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d546aa3d-62c5-4e85-887e-0f933734bd5e None None] MFA Rules not processed for user `192a22cb876f4f72b09d5835b479f58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:11.045984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d546aa3d-62c5-4e85-887e-0f933734bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:11.156890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:11.157834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:11.158127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:11.158423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:11.159090 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:11.162432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:11.247150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 870/1727] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:10 2022] POST /identity/v3/users => generated 300 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:11.248090 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:11.251021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:11.282984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675061-bc21-4e57-9f08-3e0652f5a1c0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:11.286137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 858/1728] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:11.287231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546aa3d-62c5-4e85-887e-0f933734bd5e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:11.292290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d546aa3d-62c5-4e85-887e-0f933734bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:11.315166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779bb2c-138b-4ee5-8db3-9e664e7df62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:11.316232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779bb2c-138b-4ee5-8db3-9e664e7df62e admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:11.317623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779bb2c-138b-4ee5-8db3-9e664e7df62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:11.323903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779bb2c-138b-4ee5-8db3-9e664e7df62e admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:11.325858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779bb2c-138b-4ee5-8db3-9e664e7df62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:11.329565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779bb2c-138b-4ee5-8db3-9e664e7df62e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:11.352848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:11.496035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 871/1729] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:11 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:11.506834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd630-79bb-4d23-a45d-4115a4f313d6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:11.509720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd630-79bb-4d23-a45d-4115a4f313d6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:11.511926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd630-79bb-4d23-a45d-4115a4f313d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:11.579976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-943dd630-79bb-4d23-a45d-4115a4f313d6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:11.587323 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-943dd630-79bb-4d23-a45d-4115a4f313d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:11.659966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:11.751144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546aa3d-62c5-4e85-887e-0f933734bd5e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:11.848402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 872/1730] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:11.853763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd630-79bb-4d23-a45d-4115a4f313d6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:11.861420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-943dd630-79bb-4d23-a45d-4115a4f313d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:11.940841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd630-79bb-4d23-a45d-4115a4f313d6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:11.966643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9de160-be45-4849-bd5c-676223706362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:11.968277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de160-be45-4849-bd5c-676223706362 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:11.968560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de160-be45-4849-bd5c-676223706362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:11.968834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de160-be45-4849-bd5c-676223706362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:11.969520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de160-be45-4849-bd5c-676223706362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:11.975438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de160-be45-4849-bd5c-676223706362 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.021761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 873/1731] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:12.027294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9de160-be45-4849-bd5c-676223706362 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:12.076537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9de160-be45-4849-bd5c-676223706362 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:12.094886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f24da-2833-4b2f-9325-6d03234ca718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:12.096617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e96e9-0bcc-4b0a-8010-9e610417e970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:12.097879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e96e9-0bcc-4b0a-8010-9e610417e970 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.098298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f24da-2833-4b2f-9325-6d03234ca718 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.098463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e96e9-0bcc-4b0a-8010-9e610417e970 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.098958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e96e9-0bcc-4b0a-8010-9e610417e970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.099686 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f24da-2833-4b2f-9325-6d03234ca718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.100496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f24da-2833-4b2f-9325-6d03234ca718 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.101552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f24da-2833-4b2f-9325-6d03234ca718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:12.104891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f24da-2833-4b2f-9325-6d03234ca718 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.105111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-158e96e9-0bcc-4b0a-8010-9e610417e970 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:12.176159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 874/1732] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:12 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:12.177934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7a8b0-aa7b-4fe6-91d9-74ed60fe7df3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.178117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7a8b0-aa7b-4fe6-91d9-74ed60fe7df3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.178358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7a8b0-aa7b-4fe6-91d9-74ed60fe7df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.229269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6de7a8b0-aa7b-4fe6-91d9-74ed60fe7df3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:12.238811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6de7a8b0-aa7b-4fe6-91d9-74ed60fe7df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:12.263971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 875/1733] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:12.266360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7a8b0-aa7b-4fe6-91d9-74ed60fe7df3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:12.286019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7a8b0-aa7b-4fe6-91d9-74ed60fe7df3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:12.297286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e96e9-0bcc-4b0a-8010-9e610417e970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:12.298083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743a6c0-4553-468d-b5c2-a15000691948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:12.298873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743a6c0-4553-468d-b5c2-a15000691948 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.299253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743a6c0-4553-468d-b5c2-a15000691948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.300653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743a6c0-4553-468d-b5c2-a15000691948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.302056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743a6c0-4553-468d-b5c2-a15000691948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:12.304403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e96e9-0bcc-4b0a-8010-9e610417e970 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.308084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743a6c0-4553-468d-b5c2-a15000691948 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.333816 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 876/1734] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:12.335987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743a6c0-4553-468d-b5c2-a15000691948 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:12.339437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 859/1735] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 1053 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:12.343483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74617650-8f22-4311-bee4-032f18a19462 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.344041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74617650-8f22-4311-bee4-032f18a19462 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.344466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74617650-8f22-4311-bee4-032f18a19462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.371900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743a6c0-4553-468d-b5c2-a15000691948 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:12.389633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd356e-c070-4ebc-93fd-3209f1e09b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:12.393215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd356e-c070-4ebc-93fd-3209f1e09b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.393700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd356e-c070-4ebc-93fd-3209f1e09b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.394081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd356e-c070-4ebc-93fd-3209f1e09b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.396583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd356e-c070-4ebc-93fd-3209f1e09b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:12.405525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd356e-c070-4ebc-93fd-3209f1e09b2d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.458034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 877/1736] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:12.459397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd356e-c070-4ebc-93fd-3209f1e09b2d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:12.466432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-74617650-8f22-4311-bee4-032f18a19462 None None] MFA Rules not processed for user `98468f7877eb48889976ecba85a776ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:12.471600 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-74617650-8f22-4311-bee4-032f18a19462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:12.492763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd356e-c070-4ebc-93fd-3209f1e09b2d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:12.518067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:12.522783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.525545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.526300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.530049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:12.532941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:12.535362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.570837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 878/1737] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:44:12.572116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:12.613535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a04fde-ee33-4122-999f-15d85f227765 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:12.621876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdd145-001a-4885-8687-c26c8c77c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:12.622812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdd145-001a-4885-8687-c26c8c77c6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.623214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdd145-001a-4885-8687-c26c8c77c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.623584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdd145-001a-4885-8687-c26c8c77c6c9 admin admin] PATH_INFO: `/v3/projects/1f400e291487493d90697259290c404b/users/7b4d519d01814901a8fcba5e2878b2a7/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.645849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdd145-001a-4885-8687-c26c8c77c6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f400e291487493d90697259290c404b, user_id=7b4d519d01814901a8fcba5e2878b2a7, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:12.650142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdd145-001a-4885-8687-c26c8c77c6c9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.686980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 879/1738] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:12 2022] PUT /identity/v3/projects/1f400e291487493d90697259290c404b/users/7b4d519d01814901a8fcba5e2878b2a7/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:12.689203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdd145-001a-4885-8687-c26c8c77c6c9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:12.744768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 860/1739] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:12.748959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74617650-8f22-4311-bee4-032f18a19462 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:12.804320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:12.812414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74617650-8f22-4311-bee4-032f18a19462 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:12.839596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdd145-001a-4885-8687-c26c8c77c6c9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:12.843642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712273a-ecaa-49bc-a1cc-5813978bbd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:12.844711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712273a-ecaa-49bc-a1cc-5813978bbd9c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.845186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712273a-ecaa-49bc-a1cc-5813978bbd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.845671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712273a-ecaa-49bc-a1cc-5813978bbd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.846911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712273a-ecaa-49bc-a1cc-5813978bbd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:12.850189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712273a-ecaa-49bc-a1cc-5813978bbd9c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.850486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af274a97-b217-48f8-be15-73028d34fb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:12.851212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274a97-b217-48f8-be15-73028d34fb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.851575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274a97-b217-48f8-be15-73028d34fb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.852155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af274a97-b217-48f8-be15-73028d34fb56 admin admin] PATH_INFO: `/v3/projects/5c12965694954a5b96c3e8e152186371/users/93ea9456301b4ccea1d386a24209c3d5/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.872061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af274a97-b217-48f8-be15-73028d34fb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c12965694954a5b96c3e8e152186371, user_id=93ea9456301b4ccea1d386a24209c3d5, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:12.875006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af274a97-b217-48f8-be15-73028d34fb56 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:12.893856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 880/1740] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:12 2022] PUT /identity/v3/projects/5c12965694954a5b96c3e8e152186371/users/93ea9456301b4ccea1d386a24209c3d5/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:12.895276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c80a-b098-4757-a759-c1fc806f27f4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:12.895579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c80a-b098-4757-a759-c1fc806f27f4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:12.895837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c80a-b098-4757-a759-c1fc806f27f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:12.923910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ffc6c80a-b098-4757-a759-c1fc806f27f4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:12.926452 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ffc6c80a-b098-4757-a759-c1fc806f27f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:12.982026 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:13.040501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 861/1741] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:12 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:13.040501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712273a-ecaa-49bc-a1cc-5813978bbd9c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:13.130594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 881/1742] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:13.131566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6c80a-b098-4757-a759-c1fc806f27f4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:13.193390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6c80a-b098-4757-a759-c1fc806f27f4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:13.251731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712273a-ecaa-49bc-a1cc-5813978bbd9c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:13.270998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cee0c-677a-4536-b69d-6e5c6d4f0250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:13.271667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cee0c-677a-4536-b69d-6e5c6d4f0250 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:13.271958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cee0c-677a-4536-b69d-6e5c6d4f0250 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:13.272817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cee0c-677a-4536-b69d-6e5c6d4f0250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:13.471860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cee0c-677a-4536-b69d-6e5c6d4f0250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:13.474963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cee0c-677a-4536-b69d-6e5c6d4f0250 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:13.534859 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 862/1743] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:13.536124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cee0c-677a-4536-b69d-6e5c6d4f0250 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:13.715687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:13.721929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:13.723013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:13.724262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:13.730985 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:13.742817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:13.773882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cee0c-677a-4536-b69d-6e5c6d4f0250 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:13.796061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4cc3-6891-455f-9984-9e989c10c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:13.797278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4cc3-6891-455f-9984-9e989c10c211 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:13.797789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4cc3-6891-455f-9984-9e989c10c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:13.798861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4cc3-6891-455f-9984-9e989c10c211 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:13.800370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a4cc3-6891-455f-9984-9e989c10c211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:13.805756 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 882/1744] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 675 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:13.807917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a4cc3-6891-455f-9984-9e989c10c211 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:13.810306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:13.819259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:13.876051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 863/1745] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:13 2022] POST /identity/v3/users => generated 294 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:13.877483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4cc3-6891-455f-9984-9e989c10c211 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:13.914785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4cc3-6891-455f-9984-9e989c10c211 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:13.934346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567e15-a0de-4b7e-9ab7-95695ec542aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:13.935493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567e15-a0de-4b7e-9ab7-95695ec542aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:13.938065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567e15-a0de-4b7e-9ab7-95695ec542aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:13.938592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567e15-a0de-4b7e-9ab7-95695ec542aa admin admin] PATH_INFO: `/v3/projects/5c12965694954a5b96c3e8e152186371/users/93ea9456301b4ccea1d386a24209c3d5/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:13.942721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567e15-a0de-4b7e-9ab7-95695ec542aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c12965694954a5b96c3e8e152186371, user_id=93ea9456301b4ccea1d386a24209c3d5, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:13.947453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567e15-a0de-4b7e-9ab7-95695ec542aa admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:13.983866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 864/1746] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:13 2022] PUT /identity/v3/projects/5c12965694954a5b96c3e8e152186371/users/93ea9456301b4ccea1d386a24209c3d5/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:13.985378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567e15-a0de-4b7e-9ab7-95695ec542aa admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:14.029586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be7a4-023b-43e5-846a-0e657f2196b4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:14.032728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:14.104388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:14.191271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e23ede-d0fd-4bb2-b6da-b49f8d2652db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:14.193903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23ede-d0fd-4bb2-b6da-b49f8d2652db service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:14.196212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23ede-d0fd-4bb2-b6da-b49f8d2652db service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:14.198504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e23ede-d0fd-4bb2-b6da-b49f8d2652db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:14.237177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567e15-a0de-4b7e-9ab7-95695ec542aa admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:14.256008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e23ede-d0fd-4bb2-b6da-b49f8d2652db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:14.258677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65f32e-6334-403e-88f4-90d5a0d39bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:14.259510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65f32e-6334-403e-88f4-90d5a0d39bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:14.259921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65f32e-6334-403e-88f4-90d5a0d39bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:14.261620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65f32e-6334-403e-88f4-90d5a0d39bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:14.262522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65f32e-6334-403e-88f4-90d5a0d39bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:14.270979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e23ede-d0fd-4bb2-b6da-b49f8d2652db service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:14.274940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65f32e-6334-403e-88f4-90d5a0d39bcd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:14.311673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 865/1747] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:14.313358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8a54-3fc9-49a8-a62e-13c1ff9f1fc2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:14.313772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8a54-3fc9-49a8-a62e-13c1ff9f1fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:14.314458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa8a54-3fc9-49a8-a62e-13c1ff9f1fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:14.328608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 883/1748] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:14.333594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977971e-9758-46e5-9d8c-d638dac95fd8 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:14.334427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977971e-9758-46e5-9d8c-d638dac95fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:14.335116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977971e-9758-46e5-9d8c-d638dac95fd8 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:14.339954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 884/1749] 10.222.0.49 () {54 vars in 912 bytes} [Tue Aug 30 14:44:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:44:14.342541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977971e-9758-46e5-9d8c-d638dac95fd8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:14.363483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c0aa8a54-3fc9-49a8-a62e-13c1ff9f1fc2 None None] MFA Rules not processed for user `93ea9456301b4ccea1d386a24209c3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:14.367271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c0aa8a54-3fc9-49a8-a62e-13c1ff9f1fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:14.377268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977971e-9758-46e5-9d8c-d638dac95fd8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:14.394184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa5b4f-9b53-4052-9cb3-bc369d3bd183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:14.396365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5b4f-9b53-4052-9cb3-bc369d3bd183 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:14.397101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5b4f-9b53-4052-9cb3-bc369d3bd183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:14.397691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5b4f-9b53-4052-9cb3-bc369d3bd183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:14.401179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa5b4f-9b53-4052-9cb3-bc369d3bd183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:14.406900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa5b4f-9b53-4052-9cb3-bc369d3bd183 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:14.435782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 885/1750] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:14.437425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092d5b-a355-4372-a87d-fc8885f0ec7d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:14.437903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092d5b-a355-4372-a87d-fc8885f0ec7d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:14.438727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092d5b-a355-4372-a87d-fc8885f0ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:14.495599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-02092d5b-a355-4372-a87d-fc8885f0ec7d None None] MFA Rules not processed for user `6b24f12951bd4220afad25f23f566f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:14.497905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 866/1751] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:14.503252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa8a54-3fc9-49a8-a62e-13c1ff9f1fc2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:14.503367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-02092d5b-a355-4372-a87d-fc8885f0ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:14.518453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 886/1752] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:14.520440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092d5b-a355-4372-a87d-fc8885f0ec7d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:14.523330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-02092d5b-a355-4372-a87d-fc8885f0ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:14.543604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa8a54-3fc9-49a8-a62e-13c1ff9f1fc2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:14.550036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a7c23-5366-4a21-b6ec-fc1f3667dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:14.551870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a7c23-5366-4a21-b6ec-fc1f3667dda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:14.552407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a7c23-5366-4a21-b6ec-fc1f3667dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:14.552920 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a7c23-5366-4a21-b6ec-fc1f3667dda2 admin admin] PATH_INFO: `/v3/projects/4566a181cfc74528b74e38e44203f296/users/f513efe9e85f487ea8d717402d9ead53/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:14.614013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a7c23-5366-4a21-b6ec-fc1f3667dda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4566a181cfc74528b74e38e44203f296, user_id=f513efe9e85f487ea8d717402d9ead53, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:14.622985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a7c23-5366-4a21-b6ec-fc1f3667dda2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:14.657006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 867/1753] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:14 2022] PUT /identity/v3/projects/4566a181cfc74528b74e38e44203f296/users/f513efe9e85f487ea8d717402d9ead53/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:14.678862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b71ce-0c52-48d3-a586-3bd45a7f42c5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:14.680211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b71ce-0c52-48d3-a586-3bd45a7f42c5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:14.681936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b71ce-0c52-48d3-a586-3bd45a7f42c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:14.762719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092d5b-a355-4372-a87d-fc8885f0ec7d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:14.841287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4d9b71ce-0c52-48d3-a586-3bd45a7f42c5 None None] MFA Rules not processed for user `f513efe9e85f487ea8d717402d9ead53`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:14.844639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4d9b71ce-0c52-48d3-a586-3bd45a7f42c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:15.005675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a583f-d87e-411e-a29b-90e931fcb27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:15.008467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a583f-d87e-411e-a29b-90e931fcb27c service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:15.011036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a583f-d87e-411e-a29b-90e931fcb27c service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:15.012819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a583f-d87e-411e-a29b-90e931fcb27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:15.051547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:15.074584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 868/1754] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:15.075898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b71ce-0c52-48d3-a586-3bd45a7f42c5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:15.080878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4d9b71ce-0c52-48d3-a586-3bd45a7f42c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:15.245204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b71ce-0c52-48d3-a586-3bd45a7f42c5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:15.258953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92240691-3f5e-4fea-a5b3-4a5407871f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:15.260849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240691-3f5e-4fea-a5b3-4a5407871f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:15.260849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240691-3f5e-4fea-a5b3-4a5407871f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:15.260849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240691-3f5e-4fea-a5b3-4a5407871f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:15.287767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92240691-3f5e-4fea-a5b3-4a5407871f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:15.290420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92240691-3f5e-4fea-a5b3-4a5407871f71 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:15.306609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 869/1755] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:15.307689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92240691-3f5e-4fea-a5b3-4a5407871f71 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:15.368074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a583f-d87e-411e-a29b-90e931fcb27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:15.376881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a583f-d87e-411e-a29b-90e931fcb27c service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:15.466192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 887/1756] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 947 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:15.491422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92240691-3f5e-4fea-a5b3-4a5407871f71 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:15.511042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4728a-a30d-4fc6-bdd0-55e2a3194343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:15.511751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4728a-a30d-4fc6-bdd0-55e2a3194343 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:15.512233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4728a-a30d-4fc6-bdd0-55e2a3194343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:15.512676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4728a-a30d-4fc6-bdd0-55e2a3194343 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:15.513582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4728a-a30d-4fc6-bdd0-55e2a3194343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:15.515875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4728a-a30d-4fc6-bdd0-55e2a3194343 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:15.594307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 870/1757] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:15 2022] POST /identity/v3/projects => generated 387 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:15.598945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a583f-d87e-411e-a29b-90e931fcb27c service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:15.631737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a583f-d87e-411e-a29b-90e931fcb27c service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:15.650698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788ad3-77ec-48fa-a51d-8be2f4cc422f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:15.651364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788ad3-77ec-48fa-a51d-8be2f4cc422f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:15.651833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788ad3-77ec-48fa-a51d-8be2f4cc422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:15.727267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:15.891991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b8788ad3-77ec-48fa-a51d-8be2f4cc422f None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:15.894501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b8788ad3-77ec-48fa-a51d-8be2f4cc422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:15.964441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7514dc-2330-472f-b2fb-43a1a634c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:15.965222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7514dc-2330-472f-b2fb-43a1a634c722 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:15.965610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7514dc-2330-472f-b2fb-43a1a634c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:15.966155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7514dc-2330-472f-b2fb-43a1a634c722 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:15.967089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7514dc-2330-472f-b2fb-43a1a634c722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:15.969274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7514dc-2330-472f-b2fb-43a1a634c722 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:16.046454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 888/1758] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:15 2022] POST /identity/v3/users => generated 300 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:16.047581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7514dc-2330-472f-b2fb-43a1a634c722 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:16.073267 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:16.081813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 871/1759] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:44:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:16.085394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788ad3-77ec-48fa-a51d-8be2f4cc422f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:16.137100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788ad3-77ec-48fa-a51d-8be2f4cc422f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:16.206362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9424d51-5636-4707-91e5-fbb4a098d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:16.216813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9424d51-5636-4707-91e5-fbb4a098d965 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:16.217522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9424d51-5636-4707-91e5-fbb4a098d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:16.218910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9424d51-5636-4707-91e5-fbb4a098d965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:16.223188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9424d51-5636-4707-91e5-fbb4a098d965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:16.232684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9424d51-5636-4707-91e5-fbb4a098d965 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:16.271267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7514dc-2330-472f-b2fb-43a1a634c722 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:16.281705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:16.282484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:16.282835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:16.283182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:16.288613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 872/1760] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:16.297441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9424d51-5636-4707-91e5-fbb4a098d965 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:16.298886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:16.321795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9424d51-5636-4707-91e5-fbb4a098d965 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:16.338415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bbf2d-3082-4098-80b0-a560e9534c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:16.341224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bbf2d-3082-4098-80b0-a560e9534c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:16.341853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bbf2d-3082-4098-80b0-a560e9534c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:16.342712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bbf2d-3082-4098-80b0-a560e9534c3c admin admin] PATH_INFO: `/v3/projects/1486513be14247ae9a6d82cd34460085/users/150be519d35140da91629ee38b489c06/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:16.379813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bbf2d-3082-4098-80b0-a560e9534c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1486513be14247ae9a6d82cd34460085, user_id=150be519d35140da91629ee38b489c06, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:16.383520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bbf2d-3082-4098-80b0-a560e9534c3c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:16.422428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 873/1761] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:16 2022] PUT /identity/v3/projects/1486513be14247ae9a6d82cd34460085/users/150be519d35140da91629ee38b489c06/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:16.424542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bbf2d-3082-4098-80b0-a560e9534c3c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:16.525050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:16.526743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:16.546296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 889/1762] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:16.555798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:16.567397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:16.739770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bbf2d-3082-4098-80b0-a560e9534c3c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:16.765233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ad78c-f4c1-4cd5-b664-024600d973a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:16.766540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad78c-f4c1-4cd5-b664-024600d973a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:16.769437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad78c-f4c1-4cd5-b664-024600d973a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:16.770563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad78c-f4c1-4cd5-b664-024600d973a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:16.774402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ad78c-f4c1-4cd5-b664-024600d973a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:16.785567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ad78c-f4c1-4cd5-b664-024600d973a1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:16.819583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 874/1763] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:16.825111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:16.832604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ad78c-f4c1-4cd5-b664-024600d973a1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:16.866585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ad78c-f4c1-4cd5-b664-024600d973a1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:16.886212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55420fbb-b7b0-4c17-9bfe-366cf0eb8bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:16.889070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420fbb-b7b0-4c17-9bfe-366cf0eb8bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:16.889583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420fbb-b7b0-4c17-9bfe-366cf0eb8bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:16.891046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55420fbb-b7b0-4c17-9bfe-366cf0eb8bc5 admin admin] PATH_INFO: `/v3/projects/1486513be14247ae9a6d82cd34460085/users/150be519d35140da91629ee38b489c06/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:16.902127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55420fbb-b7b0-4c17-9bfe-366cf0eb8bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1486513be14247ae9a6d82cd34460085, user_id=150be519d35140da91629ee38b489c06, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:16.907001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55420fbb-b7b0-4c17-9bfe-366cf0eb8bc5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:16.933130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56484a56-92ea-49e8-9528-0206c38cabc0 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:16.958609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 875/1764] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:16 2022] PUT /identity/v3/projects/1486513be14247ae9a6d82cd34460085/users/150be519d35140da91629ee38b489c06/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:16.982646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4bb8-ea95-470e-a7fe-d6d5df213783 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:16.993333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4bb8-ea95-470e-a7fe-d6d5df213783 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:16.993914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4bb8-ea95-470e-a7fe-d6d5df213783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:17.122282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9e7a4bb8-ea95-470e-a7fe-d6d5df213783 None None] MFA Rules not processed for user `150be519d35140da91629ee38b489c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:17.123692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9e7a4bb8-ea95-470e-a7fe-d6d5df213783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:17.187173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde7d40-b557-4dd5-879e-7ac9555e4de7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:17.190405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde7d40-b557-4dd5-879e-7ac9555e4de7 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:17.194999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde7d40-b557-4dd5-879e-7ac9555e4de7 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:17.195382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde7d40-b557-4dd5-879e-7ac9555e4de7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:17.454139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde7d40-b557-4dd5-879e-7ac9555e4de7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:17.456531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde7d40-b557-4dd5-879e-7ac9555e4de7 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:17.458011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 876/1765] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:17.460134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067271ea-566d-4455-a5e7-5a0f8810e386 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:17.460437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067271ea-566d-4455-a5e7-5a0f8810e386 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:17.460824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067271ea-566d-4455-a5e7-5a0f8810e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:17.474181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 890/1766] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 927 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:44:17.476142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde7d40-b557-4dd5-879e-7ac9555e4de7 service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:17.552967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-067271ea-566d-4455-a5e7-5a0f8810e386 None None] MFA Rules not processed for user `96fb8269dcc14300912fb686e47b988f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:17.554404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-067271ea-566d-4455-a5e7-5a0f8810e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:17.609003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:17.845475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 877/1767] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:17.862307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc6383-b2e5-43f0-b97c-123d91fbf7c1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:17.863277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc6383-b2e5-43f0-b97c-123d91fbf7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:17.863492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc6383-b2e5-43f0-b97c-123d91fbf7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:17.873435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde7d40-b557-4dd5-879e-7ac9555e4de7 service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:17.954818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-55dc6383-b2e5-43f0-b97c-123d91fbf7c1 None None] MFA Rules not processed for user `96fb8269dcc14300912fb686e47b988f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:17.959965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-55dc6383-b2e5-43f0-b97c-123d91fbf7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:17.998810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 878/1768] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:18.053343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc6383-b2e5-43f0-b97c-123d91fbf7c1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:18.069428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:18.115756 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa727ec-3898-48dc-9a6a-3c7e0892942b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:18.118735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa727ec-3898-48dc-9a6a-3c7e0892942b service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:18.119283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa727ec-3898-48dc-9a6a-3c7e0892942b service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:18.119764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa727ec-3898-48dc-9a6a-3c7e0892942b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:18.173374 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa727ec-3898-48dc-9a6a-3c7e0892942b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:18.181694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa727ec-3898-48dc-9a6a-3c7e0892942b service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:18.280097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 891/1769] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:18.288473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b745-e490-45a7-9ee0-04e87d6eb9fc None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:18.289625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b745-e490-45a7-9ee0-04e87d6eb9fc None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:18.290127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b745-e490-45a7-9ee0-04e87d6eb9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:18.494079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ec11b745-e490-45a7-9ee0-04e87d6eb9fc None None] MFA Rules not processed for user `5b64acf3f19a40ca869bf9070bad361b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:18.504720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ec11b745-e490-45a7-9ee0-04e87d6eb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:18.544664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc6383-b2e5-43f0-b97c-123d91fbf7c1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:18.571675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341201fa-8b42-4376-b3f2-dd5d9a992d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:18.572314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341201fa-8b42-4376-b3f2-dd5d9a992d23 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:18.572600 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341201fa-8b42-4376-b3f2-dd5d9a992d23 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:18.572872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341201fa-8b42-4376-b3f2-dd5d9a992d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:18.632254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341201fa-8b42-4376-b3f2-dd5d9a992d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:18.634474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341201fa-8b42-4376-b3f2-dd5d9a992d23 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:18.689236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 879/1770] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:44:18.689684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341201fa-8b42-4376-b3f2-dd5d9a992d23 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:18.845513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 892/1771] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:19.019536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341201fa-8b42-4376-b3f2-dd5d9a992d23 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:19.071821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:19.073470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:19.073992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:19.074530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] PATH_INFO: `/v3/users/f513efe9e85f487ea8d717402d9ead53` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:19.088621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f513efe9e85f487ea8d717402d9ead53)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:19.092549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:19.252292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:19.260214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f513efe9e85f487ea8d717402d9ead53'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:19.284388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f513efe9e85f487ea8d717402d9ead53'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:19.298430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f513efe9e85f487ea8d717402d9ead53'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:19.300064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f513efe9e85f487ea8d717402d9ead53'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:19.301163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6e16cd5d-1b68-4ab9-8b37-76a0ed1770e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f513efe9e85f487ea8d717402d9ead53'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:19.332361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 880/1772] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:18 2022] DELETE /identity/v3/users/f513efe9e85f487ea8d717402d9ead53 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:19.339065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3096ff-89bd-4d95-8779-864c188d235b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:19.340523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3096ff-89bd-4d95-8779-864c188d235b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:19.341213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3096ff-89bd-4d95-8779-864c188d235b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:19.483316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffdb1a-4bac-4273-8866-2ad84be937a6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:19.483316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffdb1a-4bac-4273-8866-2ad84be937a6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:19.483316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffdb1a-4bac-4273-8866-2ad84be937a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:19.483533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4e3096ff-89bd-4d95-8779-864c188d235b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:19.483533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4e3096ff-89bd-4d95-8779-864c188d235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:19.656772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d8ffdb1a-4bac-4273-8866-2ad84be937a6 None None] MFA Rules not processed for user `7b4d519d01814901a8fcba5e2878b2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:19.656772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d8ffdb1a-4bac-4273-8866-2ad84be937a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:20.060209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 893/1773] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 724 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:20.167006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3096ff-89bd-4d95-8779-864c188d235b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:20.169953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4e3096ff-89bd-4d95-8779-864c188d235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:20.227768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 881/1774] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 749 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:20.229664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffdb1a-4bac-4273-8866-2ad84be937a6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:20.235409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d8ffdb1a-4bac-4273-8866-2ad84be937a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:20.332843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffdb1a-4bac-4273-8866-2ad84be937a6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:20.368478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb896-000f-4ff8-a38a-b9d8e2732cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:20.369132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb896-000f-4ff8-a38a-b9d8e2732cad admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:20.369420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb896-000f-4ff8-a38a-b9d8e2732cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:20.369689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fb896-000f-4ff8-a38a-b9d8e2732cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:20.376860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb896-000f-4ff8-a38a-b9d8e2732cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:20.383983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fb896-000f-4ff8-a38a-b9d8e2732cad admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:20.480563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3096ff-89bd-4d95-8779-864c188d235b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:20.504694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a25c2-7094-445b-8802-62cc9a3698f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:20.508888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a25c2-7094-445b-8802-62cc9a3698f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:20.512382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a25c2-7094-445b-8802-62cc9a3698f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:20.517178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a25c2-7094-445b-8802-62cc9a3698f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:20.568652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a25c2-7094-445b-8802-62cc9a3698f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:20.573124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 882/1775] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:20 2022] POST /identity/v3/projects => generated 403 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:44:20.578201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a25c2-7094-445b-8802-62cc9a3698f8 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:20.580675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb896-000f-4ff8-a38a-b9d8e2732cad admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:20.643741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 894/1776] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:44:20.891751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fb896-000f-4ff8-a38a-b9d8e2732cad admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:20.921216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f985b8-8329-4774-984d-49a9bf7e7b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:20.926504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f985b8-8329-4774-984d-49a9bf7e7b51 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:20.927722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f985b8-8329-4774-984d-49a9bf7e7b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:20.928490 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f985b8-8329-4774-984d-49a9bf7e7b51 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:20.934135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f985b8-8329-4774-984d-49a9bf7e7b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:20.945353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f985b8-8329-4774-984d-49a9bf7e7b51 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:21.030463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 883/1777] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:20 2022] POST /identity/v3/users => generated 308 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:21.037314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a25c2-7094-445b-8802-62cc9a3698f8 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:21.091357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a25c2-7094-445b-8802-62cc9a3698f8 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:21.165414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a869ae-16ec-4e83-ba82-dac25e1f9658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:21.166616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a869ae-16ec-4e83-ba82-dac25e1f9658 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:21.167078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a869ae-16ec-4e83-ba82-dac25e1f9658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:21.167466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a869ae-16ec-4e83-ba82-dac25e1f9658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:21.168479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a869ae-16ec-4e83-ba82-dac25e1f9658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:21.171416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a869ae-16ec-4e83-ba82-dac25e1f9658 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:21.262468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 895/1778] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:21.264564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f985b8-8329-4774-984d-49a9bf7e7b51 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:21.292132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f985b8-8329-4774-984d-49a9bf7e7b51 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:21.319257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8989-23c7-47cc-89f9-f5c40ddcc392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:21.322069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8989-23c7-47cc-89f9-f5c40ddcc392 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:21.322630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8989-23c7-47cc-89f9-f5c40ddcc392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:21.323525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8989-23c7-47cc-89f9-f5c40ddcc392 admin admin] PATH_INFO: `/v3/projects/fc0a7b57917546d8b7cef5319184fa8a/users/d6551dc34b66413baeb2604f0a687cc1/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:21.377137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b8989-23c7-47cc-89f9-f5c40ddcc392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0a7b57917546d8b7cef5319184fa8a, user_id=d6551dc34b66413baeb2604f0a687cc1, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:21.383694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b8989-23c7-47cc-89f9-f5c40ddcc392 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:21.387720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:21.439640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 884/1779] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:21 2022] PUT /identity/v3/projects/fc0a7b57917546d8b7cef5319184fa8a/users/d6551dc34b66413baeb2604f0a687cc1/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:21.445571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a869ae-16ec-4e83-ba82-dac25e1f9658 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:21.474615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a869ae-16ec-4e83-ba82-dac25e1f9658 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:21.645404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:21.929996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f140b23-7bf0-4867-aac0-583129f25ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:21.936150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140b23-7bf0-4867-aac0-583129f25ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:21.937819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140b23-7bf0-4867-aac0-583129f25ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:21.938682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f140b23-7bf0-4867-aac0-583129f25ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:21.941633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f140b23-7bf0-4867-aac0-583129f25ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:21.970728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f140b23-7bf0-4867-aac0-583129f25ca6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:22.058523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 896/1780] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 613 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:22.065790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8989-23c7-47cc-89f9-f5c40ddcc392 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:22.105667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8989-23c7-47cc-89f9-f5c40ddcc392 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:22.117292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb73e-e5f6-4efb-8594-2b05bc1be020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:22.119466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb73e-e5f6-4efb-8594-2b05bc1be020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:22.121523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb73e-e5f6-4efb-8594-2b05bc1be020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:22.123029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb73e-e5f6-4efb-8594-2b05bc1be020 admin admin] PATH_INFO: `/v3/projects/fc0a7b57917546d8b7cef5319184fa8a/users/d6551dc34b66413baeb2604f0a687cc1/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:22.131559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eeb73e-e5f6-4efb-8594-2b05bc1be020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0a7b57917546d8b7cef5319184fa8a, user_id=d6551dc34b66413baeb2604f0a687cc1, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:22.137346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eeb73e-e5f6-4efb-8594-2b05bc1be020 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:22.186156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 885/1781] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:22 2022] PUT /identity/v3/projects/fc0a7b57917546d8b7cef5319184fa8a/users/d6551dc34b66413baeb2604f0a687cc1/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:23.363115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858fa1-cb01-404f-94d8-da3a905e89f8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:23.365045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858fa1-cb01-404f-94d8-da3a905e89f8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:23.365775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858fa1-cb01-404f-94d8-da3a905e89f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:23.598832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7db52-bc71-4954-a7cd-3acaea90da2d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:23.600059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7db52-bc71-4954-a7cd-3acaea90da2d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:23.600948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7db52-bc71-4954-a7cd-3acaea90da2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:23.656176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e1858fa1-cb01-404f-94d8-da3a905e89f8 None None] MFA Rules not processed for user `98468f7877eb48889976ecba85a776ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:23.674025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e1858fa1-cb01-404f-94d8-da3a905e89f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:23.829870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-04c7db52-bc71-4954-a7cd-3acaea90da2d None None] MFA Rules not processed for user `6b24f12951bd4220afad25f23f566f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:23.831944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-04c7db52-bc71-4954-a7cd-3acaea90da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:24.241106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 897/1782] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 880 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:24.261311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 886/1783] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Aug 30 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 666 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:24.470769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1858fa1-cb01-404f-94d8-da3a905e89f8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:24.505747 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1858fa1-cb01-404f-94d8-da3a905e89f8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:24.541305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:24.542521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:24.544229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:24.546750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:24.623873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:24.629930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:24.702928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 898/1784] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:26.889267 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7db52-bc71-4954-a7cd-3acaea90da2d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:26.891787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-04c7db52-bc71-4954-a7cd-3acaea90da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:27.193870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7db52-bc71-4954-a7cd-3acaea90da2d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:27.204639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:27.205746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:27.206264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:27.206890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] PATH_INFO: `/v3/users/20b4e19b7ce34551bab0d2822ec9d279` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:27.209565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b4e19b7ce34551bab0d2822ec9d279)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:27.213862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:27.344609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:27.347622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:27.419442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396aa412-c003-4e8c-b079-109fa3b00894 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:27.421120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b4e19b7ce34551bab0d2822ec9d279'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.438727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:27.440166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:27.440647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:27.441120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] PATH_INFO: `/v3/projects/4566a181cfc74528b74e38e44203f296` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:27.446569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4566a181cfc74528b74e38e44203f296)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:27.452961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:27.470247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b4e19b7ce34551bab0d2822ec9d279'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.491473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b4e19b7ce34551bab0d2822ec9d279'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.494043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b4e19b7ce34551bab0d2822ec9d279'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.495846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cd801b1f-ca62-4441-b437-e5959676064c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b4e19b7ce34551bab0d2822ec9d279'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.560912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 887/1785] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:26 2022] DELETE /identity/v3/users/20b4e19b7ce34551bab0d2822ec9d279 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:27.589070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3bae5-1a88-44a4-9eea-23e703ca8356 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:27.594915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3bae5-1a88-44a4-9eea-23e703ca8356 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:27.601254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3bae5-1a88-44a4-9eea-23e703ca8356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:27.742841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4566a181cfc74528b74e38e44203f296', 'request_id': 'req-3c2a69a1-ba69-4879-b9ca-92208758f5b5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.744381 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-16c3bae5-1a88-44a4-9eea-23e703ca8356 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:27.746944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-16c3bae5-1a88-44a4-9eea-23e703ca8356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:27.756862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4566a181cfc74528b74e38e44203f296', 'request_id': 'req-3c2a69a1-ba69-4879-b9ca-92208758f5b5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.770577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4566a181cfc74528b74e38e44203f296', 'request_id': 'req-3c2a69a1-ba69-4879-b9ca-92208758f5b5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.807231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:27.827228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] The token cache is being invalidate because project 4566a181cfc74528b74e38e44203f296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:27.830291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.838667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:27.842626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 899/1786] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:27 2022] DELETE /identity/v3/projects/4566a181cfc74528b74e38e44203f296 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:27.848377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:27.851245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:28.062638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:28.068701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 888/1787] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:28.174416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a69a1-ba69-4879-b9ca-92208758f5b5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:28.189886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:28.190864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:28.191214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:28.191632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] PATH_INFO: `/v3/users/150be519d35140da91629ee38b489c06` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:28.193463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=150be519d35140da91629ee38b489c06)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:28.200291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:28.391125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150be519d35140da91629ee38b489c06'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:28.433835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3bae5-1a88-44a4-9eea-23e703ca8356 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:28.436419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-16c3bae5-1a88-44a4-9eea-23e703ca8356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:28.488902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150be519d35140da91629ee38b489c06'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:28.493773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150be519d35140da91629ee38b489c06'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:28.505819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150be519d35140da91629ee38b489c06'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:28.530132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f1d213a-099d-4e09-8c7c-d4dc867e2901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150be519d35140da91629ee38b489c06'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:28.579206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 900/1788] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:27 2022] DELETE /identity/v3/users/150be519d35140da91629ee38b489c06 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:28.725963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3bae5-1a88-44a4-9eea-23e703ca8356 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:28.918114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:28.919011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:28.919768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:28.920585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:28.929831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:29.103273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:29.106712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:29.132867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 889/1789] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:30.581086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a05e7-6710-47db-8f9f-1559d689cd14 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:30.581869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a05e7-6710-47db-8f9f-1559d689cd14 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:30.582300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a05e7-6710-47db-8f9f-1559d689cd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:30.721598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5e4a05e7-6710-47db-8f9f-1559d689cd14 None None] MFA Rules not processed for user `d6551dc34b66413baeb2604f0a687cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:30.724433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5e4a05e7-6710-47db-8f9f-1559d689cd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:31.230085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 901/1790] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 650 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:33.695559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:33.701634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:33.779027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc61d6-9cd9-4c4b-a430-cb3c061805b5 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:33.779779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc61d6-9cd9-4c4b-a430-cb3c061805b5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:33.779779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc61d6-9cd9-4c4b-a430-cb3c061805b5 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:33.781274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 902/1791] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:44:33.805462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6a6a6-5d32-482a-bb05-5bf42f9e606a service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:33.880933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:33.887792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:33.894990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:33.895274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] PATH_INFO: `/v3/projects/1486513be14247ae9a6d82cd34460085` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:33.897513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1486513be14247ae9a6d82cd34460085)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:33.900689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:33.953487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:34.157486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1486513be14247ae9a6d82cd34460085', 'request_id': 'req-858628b1-7e6b-4d62-8633-1f80147abce0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:34.194143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1486513be14247ae9a6d82cd34460085', 'request_id': 'req-858628b1-7e6b-4d62-8633-1f80147abce0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:34.229280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1486513be14247ae9a6d82cd34460085', 'request_id': 'req-858628b1-7e6b-4d62-8633-1f80147abce0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:34.279148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] The token cache is being invalidate because project 1486513be14247ae9a6d82cd34460085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:34.281645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:34.283605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-858628b1-7e6b-4d62-8633-1f80147abce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:34.291912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 890/1792] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:33 2022] DELETE /identity/v3/projects/1486513be14247ae9a6d82cd34460085 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:34.298940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a453a9-7268-4d44-925d-61c4b85292a8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:34.299442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a453a9-7268-4d44-925d-61c4b85292a8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:34.300270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a453a9-7268-4d44-925d-61c4b85292a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:34.403687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-30a453a9-7268-4d44-925d-61c4b85292a8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:34.412217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-30a453a9-7268-4d44-925d-61c4b85292a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:34.460510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645376-ff0f-47f8-bedf-0e7982861794 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:34.461348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645376-ff0f-47f8-bedf-0e7982861794 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:34.461653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645376-ff0f-47f8-bedf-0e7982861794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:34.622876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3a645376-ff0f-47f8-bedf-0e7982861794 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:34.629188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3a645376-ff0f-47f8-bedf-0e7982861794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:34.684892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:34.800171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 903/1793] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:34.828229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0600a-584b-4f25-a8ef-12b317acfef6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:34.829590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0600a-584b-4f25-a8ef-12b317acfef6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:34.830055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0600a-584b-4f25-a8ef-12b317acfef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:34.903082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c5f0600a-584b-4f25-a8ef-12b317acfef6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:34.907935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c5f0600a-584b-4f25-a8ef-12b317acfef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:34.943371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 904/1794] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:34.947773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0600a-584b-4f25-a8ef-12b317acfef6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:34.969755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0600a-584b-4f25-a8ef-12b317acfef6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:34.989088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:34.989828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:34.990305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:34.990783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:34.991979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:34.992894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:34.995035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:35.029947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 905/1795] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:44:35.044098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:35.045174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 891/1796] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:35.091244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a11cd8-44a9-497b-8241-0d6a1d85c267 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:35.111579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842062ad-c2cd-4c9d-b8af-d2bedefd8365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:35.112652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842062ad-c2cd-4c9d-b8af-d2bedefd8365 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:35.113095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842062ad-c2cd-4c9d-b8af-d2bedefd8365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:35.113521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842062ad-c2cd-4c9d-b8af-d2bedefd8365 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:35.114403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842062ad-c2cd-4c9d-b8af-d2bedefd8365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:35.117446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842062ad-c2cd-4c9d-b8af-d2bedefd8365 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:35.162852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a645376-ff0f-47f8-bedf-0e7982861794 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:35.165740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3a645376-ff0f-47f8-bedf-0e7982861794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:35.346162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a645376-ff0f-47f8-bedf-0e7982861794 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:35.395571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:35.396858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:35.404382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:35.421532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] PATH_INFO: `/v3/projects/5cd6728de69f4473a3889d3ca96f9696` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:35.428369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd6728de69f4473a3889d3ca96f9696)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:35.441183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:35.449440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 906/1797] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:35 2022] POST /identity/v3/projects => generated 387 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:35.456246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842062ad-c2cd-4c9d-b8af-d2bedefd8365 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:35.723476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd6728de69f4473a3889d3ca96f9696', 'request_id': 'req-3e96fa14-4c5c-4809-88ac-7eff68eae862'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:35.744711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd6728de69f4473a3889d3ca96f9696', 'request_id': 'req-3e96fa14-4c5c-4809-88ac-7eff68eae862'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:35.756910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842062ad-c2cd-4c9d-b8af-d2bedefd8365 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:35.770330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd6728de69f4473a3889d3ca96f9696', 'request_id': 'req-3e96fa14-4c5c-4809-88ac-7eff68eae862'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:35.823767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] The token cache is being invalidate because project 5cd6728de69f4473a3889d3ca96f9696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:35.824462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:35.843032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3e96fa14-4c5c-4809-88ac-7eff68eae862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:35.852271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 892/1798] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:35 2022] DELETE /identity/v3/projects/5cd6728de69f4473a3889d3ca96f9696 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:35.852271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fb70-94ce-401e-8ec6-4a8e81c9f122 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:35.852271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fb70-94ce-401e-8ec6-4a8e81c9f122 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:35.852271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fb70-94ce-401e-8ec6-4a8e81c9f122 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:35.859448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 893/1799] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:44:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:44:35.860693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208fb70-94ce-401e-8ec6-4a8e81c9f122 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:35.869862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d208fb70-94ce-401e-8ec6-4a8e81c9f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:35.919768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:36.016373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:36.017615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:36.018512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:36.019183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:36.020533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:36.033788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:36.087141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208fb70-94ce-401e-8ec6-4a8e81c9f122 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:36.108336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:36.109580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:36.110481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:36.111411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] PATH_INFO: `/v3/users/b479d07c57954501a20fea6e0b847c26` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:36.122902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b479d07c57954501a20fea6e0b847c26)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:36.127077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:36.153749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 907/1800] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:35 2022] POST /identity/v3/users => generated 294 bytes in 699 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:36.157776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:36.171093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:36.303548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:36.469949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b479d07c57954501a20fea6e0b847c26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:36.535880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b479d07c57954501a20fea6e0b847c26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:36.550625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837865b1-c7c1-4386-8407-5833142bfb30 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:36.569520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b479d07c57954501a20fea6e0b847c26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:36.570625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b479d07c57954501a20fea6e0b847c26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:36.571272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6184bc20-efa9-4304-be12-738a19c62cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b479d07c57954501a20fea6e0b847c26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:36.590957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:36.598511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:36.599816 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:36.601585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:36.605036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 894/1801] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:35 2022] DELETE /identity/v3/users/b479d07c57954501a20fea6e0b847c26 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:36.609874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e974d-2c16-4fc1-9dc2-6beaf5384641 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:36.609874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e974d-2c16-4fc1-9dc2-6beaf5384641 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:36.609874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e974d-2c16-4fc1-9dc2-6beaf5384641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:36.618899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:36.670799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-871e974d-2c16-4fc1-9dc2-6beaf5384641 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:36.682694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-871e974d-2c16-4fc1-9dc2-6beaf5384641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:36.689041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:36.696027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:36.725524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 908/1802] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:36.727934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:36.730650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:36.764600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede92a3a-7a9c-42b4-beb5-3a2fbb561672 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:37.014155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d4f44-5b9d-49fa-8558-b5307b394161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:37.014840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d4f44-5b9d-49fa-8558-b5307b394161 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:37.015121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d4f44-5b9d-49fa-8558-b5307b394161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:37.017132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 895/1803] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:44:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:37.017349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d4f44-5b9d-49fa-8558-b5307b394161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:37.018108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d4f44-5b9d-49fa-8558-b5307b394161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:37.027087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d4f44-5b9d-49fa-8558-b5307b394161 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:37.062826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 909/1804] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:37.067637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e974d-2c16-4fc1-9dc2-6beaf5384641 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:37.086850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e974d-2c16-4fc1-9dc2-6beaf5384641 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:37.094157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991ead9-dc49-4746-9390-f2608687b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:37.095309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991ead9-dc49-4746-9390-f2608687b6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:37.095807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991ead9-dc49-4746-9390-f2608687b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:37.096715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991ead9-dc49-4746-9390-f2608687b6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:37.097593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991ead9-dc49-4746-9390-f2608687b6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:37.099895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991ead9-dc49-4746-9390-f2608687b6c4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:37.120956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 896/1805] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:37.123679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d4f44-5b9d-49fa-8558-b5307b394161 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:37.143086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d4f44-5b9d-49fa-8558-b5307b394161 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:37.155817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b87e3-4c73-4c1d-a853-ea697fa0ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:37.157125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b87e3-4c73-4c1d-a853-ea697fa0ec06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:37.157631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b87e3-4c73-4c1d-a853-ea697fa0ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:37.158115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b87e3-4c73-4c1d-a853-ea697fa0ec06 admin admin] PATH_INFO: `/v3/projects/e81c3b836bef4571a2684fd451384ba7/users/627feb76df28446a9bc2a64de2e9b225/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:37.228030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b87e3-4c73-4c1d-a853-ea697fa0ec06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81c3b836bef4571a2684fd451384ba7, user_id=627feb76df28446a9bc2a64de2e9b225, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:37.239571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b87e3-4c73-4c1d-a853-ea697fa0ec06 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:37.291166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 910/1806] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:37 2022] PUT /identity/v3/projects/e81c3b836bef4571a2684fd451384ba7/users/627feb76df28446a9bc2a64de2e9b225/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:37.299976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9a89-d4e6-455b-9dd5-997757f52224 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:37.300263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9a89-d4e6-455b-9dd5-997757f52224 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:37.300537 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9a89-d4e6-455b-9dd5-997757f52224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:37.401568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:37.420974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3beb9a89-d4e6-455b-9dd5-997757f52224 None None] MFA Rules not processed for user `627feb76df28446a9bc2a64de2e9b225`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:37.432257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3beb9a89-d4e6-455b-9dd5-997757f52224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:37.715294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 897/1807] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:37.722775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b87e3-4c73-4c1d-a853-ea697fa0ec06 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:37.855037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b87e3-4c73-4c1d-a853-ea697fa0ec06 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:37.864440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2032-1760-4f0a-8fa9-3c7fa83a4277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:37.865384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2032-1760-4f0a-8fa9-3c7fa83a4277 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:37.865865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2032-1760-4f0a-8fa9-3c7fa83a4277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:37.866371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa2032-1760-4f0a-8fa9-3c7fa83a4277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:37.867736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa2032-1760-4f0a-8fa9-3c7fa83a4277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:37.870654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa2032-1760-4f0a-8fa9-3c7fa83a4277 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:37.921970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb9a89-d4e6-455b-9dd5-997757f52224 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:37.923834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3beb9a89-d4e6-455b-9dd5-997757f52224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:37.924799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 911/1808] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:37 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:37.931822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2032-1760-4f0a-8fa9-3c7fa83a4277 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:37.990864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:38.102137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa2032-1760-4f0a-8fa9-3c7fa83a4277 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:38.111627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3b628-8e67-4a0e-9e88-038c86acc306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:38.112843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b628-8e67-4a0e-9e88-038c86acc306 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.130533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b628-8e67-4a0e-9e88-038c86acc306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.133388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3b628-8e67-4a0e-9e88-038c86acc306 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.134625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3b628-8e67-4a0e-9e88-038c86acc306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:38.138462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3b628-8e67-4a0e-9e88-038c86acc306 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:38.164789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb9a89-d4e6-455b-9dd5-997757f52224 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:38.199016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 912/1809] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:37 2022] POST /identity/v3/users => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:38.204205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3b628-8e67-4a0e-9e88-038c86acc306 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:38.226217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3b628-8e67-4a0e-9e88-038c86acc306 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:38.234759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3727-492a-43b3-a937-849f6522e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:38.235918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3727-492a-43b3-a937-849f6522e6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.236483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3727-492a-43b3-a937-849f6522e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.237020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3727-492a-43b3-a937-849f6522e6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.238299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3727-492a-43b3-a937-849f6522e6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:38.241576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3727-492a-43b3-a937-849f6522e6a9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:38.266051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 913/1810] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:38.268069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3727-492a-43b3-a937-849f6522e6a9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:38.285760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3727-492a-43b3-a937-849f6522e6a9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:38.294903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74778-28f4-4702-bee2-6821653abf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:38.296008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74778-28f4-4702-bee2-6821653abf79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.296464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74778-28f4-4702-bee2-6821653abf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.296939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74778-28f4-4702-bee2-6821653abf79 admin admin] PATH_INFO: `/v3/projects/8635d7547cd24d9588996857ba8ea76b/users/25f29664b8b1400ebf4382f03a32be09/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.308777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b23a-f432-4fac-a88c-ffd6ccabdf69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:38.310002 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b23a-f432-4fac-a88c-ffd6ccabdf69 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.310557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b23a-f432-4fac-a88c-ffd6ccabdf69 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.311104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b23a-f432-4fac-a88c-ffd6ccabdf69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.324391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74778-28f4-4702-bee2-6821653abf79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8635d7547cd24d9588996857ba8ea76b, user_id=25f29664b8b1400ebf4382f03a32be09, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:38.326966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2b23a-f432-4fac-a88c-ffd6ccabdf69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:38.328871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2b23a-f432-4fac-a88c-ffd6ccabdf69 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:38.329171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74778-28f4-4702-bee2-6821653abf79 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:38.346531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 898/1811] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:38.353547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 914/1812] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:38 2022] PUT /identity/v3/projects/8635d7547cd24d9588996857ba8ea76b/users/25f29664b8b1400ebf4382f03a32be09/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:38.358704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b23a-f432-4fac-a88c-ffd6ccabdf69 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:38.377383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b23a-f432-4fac-a88c-ffd6ccabdf69 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:38.450258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:38.516400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b907-753b-40e9-8b1b-ae76f46ccb86 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.520392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b907-753b-40e9-8b1b-ae76f46ccb86 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.520392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b907-753b-40e9-8b1b-ae76f46ccb86 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.525613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 915/1813] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:44:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:44:38.571625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e183f-dcad-4dbb-a4db-cbe5620505f5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.572204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e183f-dcad-4dbb-a4db-cbe5620505f5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.572774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e183f-dcad-4dbb-a4db-cbe5620505f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.613263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ca5b-0cfd-44a8-9111-b654dec9f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:38.614893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ca5b-0cfd-44a8-9111-b654dec9f72c admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.615539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ca5b-0cfd-44a8-9111-b654dec9f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.616150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754ca5b-0cfd-44a8-9111-b654dec9f72c admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.617650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ca5b-0cfd-44a8-9111-b654dec9f72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:38.624907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754ca5b-0cfd-44a8-9111-b654dec9f72c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:38.643472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ed1e183f-dcad-4dbb-a4db-cbe5620505f5 None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:38.645813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ed1e183f-dcad-4dbb-a4db-cbe5620505f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:38.655553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 899/1814] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:44:38.677254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ca5b-0cfd-44a8-9111-b654dec9f72c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:38.767637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754ca5b-0cfd-44a8-9111-b654dec9f72c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:38.818150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf94de-004a-4ced-99b1-fdf6156b2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:38.819619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf94de-004a-4ced-99b1-fdf6156b2cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.822289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf94de-004a-4ced-99b1-fdf6156b2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.826462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf94de-004a-4ced-99b1-fdf6156b2cd0 admin admin] PATH_INFO: `/v3/projects/8635d7547cd24d9588996857ba8ea76b/users/25f29664b8b1400ebf4382f03a32be09/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.838027 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf94de-004a-4ced-99b1-fdf6156b2cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8635d7547cd24d9588996857ba8ea76b, user_id=25f29664b8b1400ebf4382f03a32be09, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:38.847493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf94de-004a-4ced-99b1-fdf6156b2cd0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:38.894828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 900/1815] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:38 2022] PUT /identity/v3/projects/8635d7547cd24d9588996857ba8ea76b/users/25f29664b8b1400ebf4382f03a32be09/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:38.909898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ea8a3-d94e-4e0e-a8b3-65340cab2c9f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:38.911050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ea8a3-d94e-4e0e-a8b3-65340cab2c9f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:38.911969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ea8a3-d94e-4e0e-a8b3-65340cab2c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:38.920538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 916/1816] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:44:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:39.006891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9030c-14c1-43ed-8c2a-180424f0f559 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:39.008061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9030c-14c1-43ed-8c2a-180424f0f559 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:39.008352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9030c-14c1-43ed-8c2a-180424f0f559 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:39.011493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 917/1817] 10.222.0.49 () {54 vars in 961 bytes} [Tue Aug 30 14:44:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:44:39.019997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7a8ea8a3-d94e-4e0e-a8b3-65340cab2c9f None None] MFA Rules not processed for user `25f29664b8b1400ebf4382f03a32be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:39.021099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244908-da9a-4e92-92d9-012604711ae5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:39.021631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244908-da9a-4e92-92d9-012604711ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:39.022215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244908-da9a-4e92-92d9-012604711ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:39.025308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7a8ea8a3-d94e-4e0e-a8b3-65340cab2c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:39.081634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-45244908-da9a-4e92-92d9-012604711ae5 None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:39.091910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-45244908-da9a-4e92-92d9-012604711ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:39.219968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 918/1818] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Aug 30 14:44:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:39.229259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45244908-da9a-4e92-92d9-012604711ae5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:39.234276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:39.247526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45244908-da9a-4e92-92d9-012604711ae5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:39.256346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b42f6-4ab6-412e-9a7a-8be10be880eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:39.257314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b42f6-4ab6-412e-9a7a-8be10be880eb service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:39.257834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b42f6-4ab6-412e-9a7a-8be10be880eb service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:39.258206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b42f6-4ab6-412e-9a7a-8be10be880eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:39.269776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b42f6-4ab6-412e-9a7a-8be10be880eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:39.271755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b42f6-4ab6-412e-9a7a-8be10be880eb service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:39.280382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 901/1819] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:39.295532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 919/1820] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:39.296398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ea8a3-d94e-4e0e-a8b3-65340cab2c9f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:39.301591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7a8ea8a3-d94e-4e0e-a8b3-65340cab2c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:39.447213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ea8a3-d94e-4e0e-a8b3-65340cab2c9f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:39.458194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:39.468103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:39.469671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:39.471641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:39.516857 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:39.523037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:39.546728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 902/1821] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:44:39.806757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b42f6-4ab6-412e-9a7a-8be10be880eb service placement] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:40.031686 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b42f6-4ab6-412e-9a7a-8be10be880eb service placement] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:40.043306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:40.044432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:40.044899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:40.045401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] PATH_INFO: `/v3/users/627feb76df28446a9bc2a64de2e9b225` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:40.047558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] RBAC: Authorizing `identity:delete_user(user_id=627feb76df28446a9bc2a64de2e9b225)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:40.053101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:40.243028 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:40.245758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:40.266774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627feb76df28446a9bc2a64de2e9b225'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.292437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f20b39-0d39-4114-b5c3-08233b31c3f7 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:40.316578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627feb76df28446a9bc2a64de2e9b225'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.318106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:40.319515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:40.321222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:40.321708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] PATH_INFO: `/v3/projects/e6b2842030564571acb57b74280e38c5` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:40.322245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627feb76df28446a9bc2a64de2e9b225'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.327873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627feb76df28446a9bc2a64de2e9b225'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.328412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b2842030564571acb57b74280e38c5)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:40.336658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:40.387000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e75ebbab-cf7a-441e-9dff-7d736d43199e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627feb76df28446a9bc2a64de2e9b225'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.435913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 920/1822] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:39 2022] DELETE /identity/v3/users/627feb76df28446a9bc2a64de2e9b225 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:40.448434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690c04-f940-42e7-ba72-714d0ce55cf4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:40.451050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690c04-f940-42e7-ba72-714d0ce55cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:40.451313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6690c04-f940-42e7-ba72-714d0ce55cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:40.458350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:40.491142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b2842030564571acb57b74280e38c5', 'request_id': 'req-eb88249a-186f-414f-bea4-da48a102c189'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.503418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a6690c04-f940-42e7-ba72-714d0ce55cf4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:40.504721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a6690c04-f940-42e7-ba72-714d0ce55cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:40.506288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b2842030564571acb57b74280e38c5', 'request_id': 'req-eb88249a-186f-414f-bea4-da48a102c189'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.535657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b2842030564571acb57b74280e38c5', 'request_id': 'req-eb88249a-186f-414f-bea4-da48a102c189'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.577772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] The token cache is being invalidate because project e6b2842030564571acb57b74280e38c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:40.578079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.581449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-eb88249a-186f-414f-bea4-da48a102c189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:40.584698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 903/1823] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:40 2022] DELETE /identity/v3/projects/e6b2842030564571acb57b74280e38c5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:40.591535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707e2c-3c81-4c44-aec8-2018a749c935 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:40.591840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707e2c-3c81-4c44-aec8-2018a749c935 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:40.592138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707e2c-3c81-4c44-aec8-2018a749c935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:40.668461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-51707e2c-3c81-4c44-aec8-2018a749c935 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:40.672371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-51707e2c-3c81-4c44-aec8-2018a749c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:40.721876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 921/1824] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:40.747975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6690c04-f940-42e7-ba72-714d0ce55cf4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:40.754914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a6690c04-f940-42e7-ba72-714d0ce55cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:40.821222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:40.922685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 904/1825] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:40.935927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924751-803f-42d2-8706-b4e00ffb6b1d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:40.939483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924751-803f-42d2-8706-b4e00ffb6b1d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:40.940652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924751-803f-42d2-8706-b4e00ffb6b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.012762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6690c04-f940-42e7-ba72-714d0ce55cf4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:41.023432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a524-038a-421c-935a-870a7d6c90cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:41.025546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a524-038a-421c-935a-870a7d6c90cf service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:41.026503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a524-038a-421c-935a-870a7d6c90cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:41.027336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a524-038a-421c-935a-870a7d6c90cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.032094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-40924751-803f-42d2-8706-b4e00ffb6b1d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:41.034146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-40924751-803f-42d2-8706-b4e00ffb6b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:41.048248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a524-038a-421c-935a-870a7d6c90cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:41.051718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a524-038a-421c-935a-870a7d6c90cf service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:41.073301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 922/1826] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:41.075038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 905/1827] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:41.082339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a524-038a-421c-935a-870a7d6c90cf service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:41.104459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a524-038a-421c-935a-870a7d6c90cf service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:41.113896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:41.115547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:41.116131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:41.116887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.118495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:41.119175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:41.123263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:41.150459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 923/1828] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:44:41.155088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40924751-803f-42d2-8706-b4e00ffb6b1d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:41.172239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40924751-803f-42d2-8706-b4e00ffb6b1d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:41.183351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac69a4a-7bc4-4655-a1df-ad2c4270ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:41.184390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac69a4a-7bc4-4655-a1df-ad2c4270ac31 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:41.184771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac69a4a-7bc4-4655-a1df-ad2c4270ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:41.185139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac69a4a-7bc4-4655-a1df-ad2c4270ac31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.185918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac69a4a-7bc4-4655-a1df-ad2c4270ac31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:41.188834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac69a4a-7bc4-4655-a1df-ad2c4270ac31 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:41.262014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 906/1829] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:41 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:41.265872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:41.289893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f0d2c-7d48-4433-ad42-e969f34b2af8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:41.437940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb736c0-9c59-493d-b06b-fe94a133f5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:41.438833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb736c0-9c59-493d-b06b-fe94a133f5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:41.439533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb736c0-9c59-493d-b06b-fe94a133f5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:41.440067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb736c0-9c59-493d-b06b-fe94a133f5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.441028 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb736c0-9c59-493d-b06b-fe94a133f5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:41.444557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb736c0-9c59-493d-b06b-fe94a133f5b7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:41.475319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 924/1830] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:41 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:41.482234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac69a4a-7bc4-4655-a1df-ad2c4270ac31 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:41.496493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac69a4a-7bc4-4655-a1df-ad2c4270ac31 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:41.527610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9b399-2f4e-43dc-90b6-346e72016dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:41.529040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9b399-2f4e-43dc-90b6-346e72016dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:41.530255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9b399-2f4e-43dc-90b6-346e72016dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:41.531110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9b399-2f4e-43dc-90b6-346e72016dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.532521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9b399-2f4e-43dc-90b6-346e72016dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:41.537600 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9b399-2f4e-43dc-90b6-346e72016dc6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:41.562772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 907/1831] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:44:41.568971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb736c0-9c59-493d-b06b-fe94a133f5b7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:41.605653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb736c0-9c59-493d-b06b-fe94a133f5b7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:41.629459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1de94f-8f57-4048-9b28-e3915e027676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:41.631034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1de94f-8f57-4048-9b28-e3915e027676 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:41.631819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1de94f-8f57-4048-9b28-e3915e027676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:41.632480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1de94f-8f57-4048-9b28-e3915e027676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.636131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1de94f-8f57-4048-9b28-e3915e027676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:41.644289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1de94f-8f57-4048-9b28-e3915e027676 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:41.695658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 925/1832] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:41.702483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9b399-2f4e-43dc-90b6-346e72016dc6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:41.728293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9b399-2f4e-43dc-90b6-346e72016dc6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:41.743563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:41.744510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:41.744887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:41.745426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] PATH_INFO: `/v3/projects/ba6a655700694f16bc12766e67a89044/users/0c19288fe5744e38ade1e4b47a4af1f9/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.785625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6a655700694f16bc12766e67a89044, user_id=0c19288fe5744e38ade1e4b47a4af1f9, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:41.796670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:41.826903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 908/1833] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:41 2022] PUT /identity/v3/projects/ba6a655700694f16bc12766e67a89044/users/0c19288fe5744e38ade1e4b47a4af1f9/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:41.847876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580293-d9d5-4657-9464-ca6429f29799 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:41.849489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580293-d9d5-4657-9464-ca6429f29799 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:41.849489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580293-d9d5-4657-9464-ca6429f29799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:41.872358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:41.874494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:41.985554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-07580293-d9d5-4657-9464-ca6429f29799 None None] MFA Rules not processed for user `0c19288fe5744e38ade1e4b47a4af1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:41.987672 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-07580293-d9d5-4657-9464-ca6429f29799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:42.027400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:42.038950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cff64-f4f1-4c2f-9a95-889949095541 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:42.054917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:42.056905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:42.058148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:42.058862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] PATH_INFO: `/v3/users/7b4d519d01814901a8fcba5e2878b2a7` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:42.062021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4d519d01814901a8fcba5e2878b2a7)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:42.068077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:42.204072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 926/1834] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:42.207856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580293-d9d5-4657-9464-ca6429f29799 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:42.233904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580293-d9d5-4657-9464-ca6429f29799 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:42.254537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:42.257209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:42.260005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:42.260005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:42.262423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:42.270769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4d519d01814901a8fcba5e2878b2a7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:42.272422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:42.293439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:42.339414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4d519d01814901a8fcba5e2878b2a7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:42.360192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4d519d01814901a8fcba5e2878b2a7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:42.361769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4d519d01814901a8fcba5e2878b2a7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:42.377045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4d519d01814901a8fcba5e2878b2a7'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:42.395864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 927/1835] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:42 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:42.404982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:42.421225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:42.449098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 909/1836] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:41 2022] DELETE /identity/v3/users/7b4d519d01814901a8fcba5e2878b2a7 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:42.621552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cffb9b-152f-4cf2-9fdd-20969418e750 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:42.785857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98aecce-d699-4875-9b22-4575bca87916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:42.790769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98aecce-d699-4875-9b22-4575bca87916 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:42.791496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98aecce-d699-4875-9b22-4575bca87916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:42.792094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98aecce-d699-4875-9b22-4575bca87916 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:42.794331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98aecce-d699-4875-9b22-4575bca87916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:42.798527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98aecce-d699-4875-9b22-4575bca87916 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:42.869492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 928/1837] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:42 2022] POST /identity/v3/users => generated 291 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:42.873413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:42.917286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba23f3-cd42-4b6b-8c6f-9bcd2663f058 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:42.953218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2bc02-484a-4f1e-8ecb-f3cf25c9defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:42.959396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2bc02-484a-4f1e-8ecb-f3cf25c9defe admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:42.962405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2bc02-484a-4f1e-8ecb-f3cf25c9defe admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:42.963318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2bc02-484a-4f1e-8ecb-f3cf25c9defe admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:42.964889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2bc02-484a-4f1e-8ecb-f3cf25c9defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:42.969693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2bc02-484a-4f1e-8ecb-f3cf25c9defe admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:43.051566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98aecce-d699-4875-9b22-4575bca87916 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:43.052163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 910/1838] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:43.107018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98aecce-d699-4875-9b22-4575bca87916 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:43.147254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:43.153871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:43.154662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:43.162461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] PATH_INFO: `/v3/projects/a1078f587edb46c6ac9c36f1370500ac/users/0cfaacc5b7954764a5be540e8f0a9891/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:43.228569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1078f587edb46c6ac9c36f1370500ac, user_id=0cfaacc5b7954764a5be540e8f0a9891, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:43.245110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:43.292616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 929/1839] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:43 2022] PUT /identity/v3/projects/a1078f587edb46c6ac9c36f1370500ac/users/0cfaacc5b7954764a5be540e8f0a9891/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:43.298717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2bc02-484a-4f1e-8ecb-f3cf25c9defe admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:43.337492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2bc02-484a-4f1e-8ecb-f3cf25c9defe admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:43.343405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:43.345873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:43.496607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:43.525680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c3d6b-a6d2-4550-8935-7948c05623a1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:43.533635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:43.534780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:43.535206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:43.535612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] PATH_INFO: `/v3/projects/e81c3b836bef4571a2684fd451384ba7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:43.537245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81c3b836bef4571a2684fd451384ba7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:43.540014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:43.551742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fffc6-ab3d-4bad-a24a-05a6f32f3ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:43.552563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fffc6-ab3d-4bad-a24a-05a6f32f3ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:43.552939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fffc6-ab3d-4bad-a24a-05a6f32f3ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:43.553306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fffc6-ab3d-4bad-a24a-05a6f32f3ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:43.554225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fffc6-ab3d-4bad-a24a-05a6f32f3ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:43.560876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fffc6-ab3d-4bad-a24a-05a6f32f3ff7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:43.605567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 911/1840] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:43.611788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fffc6-ab3d-4bad-a24a-05a6f32f3ff7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:43.620243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81c3b836bef4571a2684fd451384ba7', 'request_id': 'req-28e361be-b134-4217-baa8-76b3a7011473'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:43.630980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81c3b836bef4571a2684fd451384ba7', 'request_id': 'req-28e361be-b134-4217-baa8-76b3a7011473'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:43.634263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fffc6-ab3d-4bad-a24a-05a6f32f3ff7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:43.640451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81c3b836bef4571a2684fd451384ba7', 'request_id': 'req-28e361be-b134-4217-baa8-76b3a7011473'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:43.674512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] The token cache is being invalidate because project e81c3b836bef4571a2684fd451384ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:43.674813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:43.676055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:43.685004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 930/1841] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:43 2022] DELETE /identity/v3/projects/e81c3b836bef4571a2684fd451384ba7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:43.688636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:43.690889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:43.875930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffbab5-119e-4250-b088-d8cf00b9a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:43.879943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffbab5-119e-4250-b088-d8cf00b9a4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:43.879943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffbab5-119e-4250-b088-d8cf00b9a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:43.882838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffbab5-119e-4250-b088-d8cf00b9a4e2 admin admin] PATH_INFO: `/v3/projects/a1078f587edb46c6ac9c36f1370500ac/users/0cfaacc5b7954764a5be540e8f0a9891/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:43.896614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffbab5-119e-4250-b088-d8cf00b9a4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1078f587edb46c6ac9c36f1370500ac, user_id=0cfaacc5b7954764a5be540e8f0a9891, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:43.905024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffbab5-119e-4250-b088-d8cf00b9a4e2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:43.916861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:43.931250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e361be-b134-4217-baa8-76b3a7011473 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:43.959295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 912/1842] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:43 2022] PUT /identity/v3/projects/a1078f587edb46c6ac9c36f1370500ac/users/0cfaacc5b7954764a5be540e8f0a9891/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:43.965442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d3ae2-b40b-4741-8b0a-bb6fb917d669 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:43.965922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d3ae2-b40b-4741-8b0a-bb6fb917d669 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:43.966428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d3ae2-b40b-4741-8b0a-bb6fb917d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:44.068787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:44.069571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:44.069945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:44.070338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] PATH_INFO: `/v3/users/25f29664b8b1400ebf4382f03a32be09` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:44.072462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f29664b8b1400ebf4382f03a32be09)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:44.074611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:44.097087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-900d3ae2-b40b-4741-8b0a-bb6fb917d669 None None] MFA Rules not processed for user `0cfaacc5b7954764a5be540e8f0a9891`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:44.103902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-900d3ae2-b40b-4741-8b0a-bb6fb917d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:44.163824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:44.200736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f29664b8b1400ebf4382f03a32be09'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.243810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f29664b8b1400ebf4382f03a32be09'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.245810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f29664b8b1400ebf4382f03a32be09'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.245810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f29664b8b1400ebf4382f03a32be09'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.271541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f29664b8b1400ebf4382f03a32be09'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.322223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 931/1843] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:43 2022] DELETE /identity/v3/users/25f29664b8b1400ebf4382f03a32be09 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:44.369433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:44.371875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:44.399659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 913/1844] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:44.426070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d3ae2-b40b-4741-8b0a-bb6fb917d669 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:44.428148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-900d3ae2-b40b-4741-8b0a-bb6fb917d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:44.549847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2808901-ebbb-473b-b671-a472b7ede5b8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:44.558041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:44.558925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:44.559207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:44.559478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] PATH_INFO: `/v3/projects/1f400e291487493d90697259290c404b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:44.560714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f400e291487493d90697259290c404b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:44.562716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:44.598958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d3ae2-b40b-4741-8b0a-bb6fb917d669 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:44.627559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f400e291487493d90697259290c404b', 'request_id': 'req-bcb1a139-5266-438b-89a0-29a508e3efe6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.641635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f400e291487493d90697259290c404b', 'request_id': 'req-bcb1a139-5266-438b-89a0-29a508e3efe6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.655443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f400e291487493d90697259290c404b', 'request_id': 'req-bcb1a139-5266-438b-89a0-29a508e3efe6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.697356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] The token cache is being invalidate because project 1f400e291487493d90697259290c404b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:44.697673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.701037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bcb1a139-5266-438b-89a0-29a508e3efe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:44.703212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 932/1845] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:44 2022] DELETE /identity/v3/projects/1f400e291487493d90697259290c404b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:44.704749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79123-9779-4497-8e6b-4e7a5ef4ac4f None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:44.705035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79123-9779-4497-8e6b-4e7a5ef4ac4f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:44.705313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e79123-9779-4497-8e6b-4e7a5ef4ac4f None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:44.706765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 933/1846] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:44:44.722577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e79123-9779-4497-8e6b-4e7a5ef4ac4f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:44.724903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f9e79123-9779-4497-8e6b-4e7a5ef4ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:44.822056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:44.860291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:44.861672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:44.862410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:44.863109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:44.864622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e79123-9779-4497-8e6b-4e7a5ef4ac4f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:44.875662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:44.876661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:44.877094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:44.878049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] PATH_INFO: `/v3/users/d6551dc34b66413baeb2604f0a687cc1` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:44.880669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6551dc34b66413baeb2604f0a687cc1)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:44.884176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:44.887506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:44.994705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6551dc34b66413baeb2604f0a687cc1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:45.031900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6551dc34b66413baeb2604f0a687cc1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:45.033854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6551dc34b66413baeb2604f0a687cc1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:45.037701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6551dc34b66413baeb2604f0a687cc1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:45.063717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2f69378f-662c-4a0c-8725-4dcb5730e435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6551dc34b66413baeb2604f0a687cc1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:45.096330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 934/1847] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:44 2022] DELETE /identity/v3/users/d6551dc34b66413baeb2604f0a687cc1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:45.097709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee184-e7d5-4fe6-b91c-676f4bf41df9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:45.097986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee184-e7d5-4fe6-b91c-676f4bf41df9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:45.098255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee184-e7d5-4fe6-b91c-676f4bf41df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:45.105096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:45.147219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:45.151450 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:45.190921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 914/1848] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:44:45.196828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-166ee184-e7d5-4fe6-b91c-676f4bf41df9 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:45.199893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-166ee184-e7d5-4fe6-b91c-676f4bf41df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:45.330429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:45.331910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:45.390180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a94a8-6e7b-454e-bf48-2754dc41e73a service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:45.423606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 935/1849] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:44:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:45.540022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadff7b4-ccbf-4f5c-826e-7d801a8a7c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:45.542137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadff7b4-ccbf-4f5c-826e-7d801a8a7c76 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:45.543079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadff7b4-ccbf-4f5c-826e-7d801a8a7c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:45.543712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadff7b4-ccbf-4f5c-826e-7d801a8a7c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:45.548218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-aadff7b4-ccbf-4f5c-826e-7d801a8a7c76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:45.661732 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee184-e7d5-4fe6-b91c-676f4bf41df9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:45.664480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-166ee184-e7d5-4fe6-b91c-676f4bf41df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:45.696601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee184-e7d5-4fe6-b91c-676f4bf41df9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:45.711279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:45.712210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:45.714876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:45.715363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:45.752197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:45.756295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:45.765443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadff7b4-ccbf-4f5c-826e-7d801a8a7c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:45.767202 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadff7b4-ccbf-4f5c-826e-7d801a8a7c76 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:45.791693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 936/1850] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:45.794843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:45.796610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 915/1851] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:45.798526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:45.947547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:46.026368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f0f0-938c-4d1c-a662-bb0dc42c7187 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:46.044078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:46.046765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:46.047140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:46.047422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] PATH_INFO: `/v3/projects/8635d7547cd24d9588996857ba8ea76b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:46.054506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8635d7547cd24d9588996857ba8ea76b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:46.061229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:46.244314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8635d7547cd24d9588996857ba8ea76b', 'request_id': 'req-db016007-ac76-462d-8961-e0aa64fa1ecc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:46.259141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8635d7547cd24d9588996857ba8ea76b', 'request_id': 'req-db016007-ac76-462d-8961-e0aa64fa1ecc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:46.277957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8635d7547cd24d9588996857ba8ea76b', 'request_id': 'req-db016007-ac76-462d-8961-e0aa64fa1ecc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:46.311084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] The token cache is being invalidate because project 8635d7547cd24d9588996857ba8ea76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:46.312932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:46.314799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-db016007-ac76-462d-8961-e0aa64fa1ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:46.319490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 937/1852] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:45 2022] DELETE /identity/v3/projects/8635d7547cd24d9588996857ba8ea76b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:46.327402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae574-5cca-4cfd-85ad-0460df768c0d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:46.328561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae574-5cca-4cfd-85ad-0460df768c0d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:46.329011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae574-5cca-4cfd-85ad-0460df768c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:46.368247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-001ae574-5cca-4cfd-85ad-0460df768c0d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:46.370558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-001ae574-5cca-4cfd-85ad-0460df768c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:46.632525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 916/1853] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:46.644110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aec65-bdf3-4e02-bd38-9c12db390bf7 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:46.645208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aec65-bdf3-4e02-bd38-9c12db390bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:46.645727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aec65-bdf3-4e02-bd38-9c12db390bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:46.699669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ca5aec65-bdf3-4e02-bd38-9c12db390bf7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:46.703096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ca5aec65-bdf3-4e02-bd38-9c12db390bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:46.729009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 938/1854] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:46.735438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ae574-5cca-4cfd-85ad-0460df768c0d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:46.758230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ae574-5cca-4cfd-85ad-0460df768c0d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:46.776855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:46.777658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:46.778049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:46.778533 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:46.779097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:46.779405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:46.781871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:46.855341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 917/1855] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:44:46.863196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aec65-bdf3-4e02-bd38-9c12db390bf7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:46.900269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aec65-bdf3-4e02-bd38-9c12db390bf7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:46.927546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea89ae0-6207-41e8-b810-507700993706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:46.934808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89ae0-6207-41e8-b810-507700993706 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:46.938460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89ae0-6207-41e8-b810-507700993706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:46.939295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89ae0-6207-41e8-b810-507700993706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:46.942904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea89ae0-6207-41e8-b810-507700993706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:46.957375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea89ae0-6207-41e8-b810-507700993706 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:47.014749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:47.017741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:47.063399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12304a79-7925-4a56-8b4a-932125b6af82 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:47.076056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:47.076881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.077385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.077766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] PATH_INFO: `/v3/projects/fc0a7b57917546d8b7cef5319184fa8a` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.079807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0a7b57917546d8b7cef5319184fa8a)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:47.086111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:47.176393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 939/1856] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:46 2022] POST /identity/v3/projects => generated 407 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:47.184309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea89ae0-6207-41e8-b810-507700993706 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:47.250847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:47.360417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0a7b57917546d8b7cef5319184fa8a', 'request_id': 'req-bdfdab90-d806-411c-86a7-fd08e0190d81'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:47.386235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0a7b57917546d8b7cef5319184fa8a', 'request_id': 'req-bdfdab90-d806-411c-86a7-fd08e0190d81'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:47.424542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0a7b57917546d8b7cef5319184fa8a', 'request_id': 'req-bdfdab90-d806-411c-86a7-fd08e0190d81'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:47.477904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] The token cache is being invalidate because project fc0a7b57917546d8b7cef5319184fa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:47.479670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:47.484539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bdfdab90-d806-411c-86a7-fd08e0190d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:47.498771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 918/1857] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:47 2022] DELETE /identity/v3/projects/fc0a7b57917546d8b7cef5319184fa8a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:47.506267 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1d31-af65-4d04-919d-30cfdbd5fcde None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.506553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1d31-af65-4d04-919d-30cfdbd5fcde None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.508143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b1d31-af65-4d04-919d-30cfdbd5fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.535494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea89ae0-6207-41e8-b810-507700993706 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:47.560519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e84b1d31-af65-4d04-919d-30cfdbd5fcde None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:47.561827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e84b1d31-af65-4d04-919d-30cfdbd5fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:47.650100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:47.675872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:47.676810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.677221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.677702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.679250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:47.683101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:47.683575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 919/1858] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:47.702151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d0b57-7fb9-47a3-9f05-689811f63e0e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.702912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d0b57-7fb9-47a3-9f05-689811f63e0e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.703604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d0b57-7fb9-47a3-9f05-689811f63e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.742037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6e9d0b57-7fb9-47a3-9f05-689811f63e0e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:47.743385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6e9d0b57-7fb9-47a3-9f05-689811f63e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:47.755539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 920/1859] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:47.762617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d0b57-7fb9-47a3-9f05-689811f63e0e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:47.781600 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d0b57-7fb9-47a3-9f05-689811f63e0e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:47.787955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 940/1860] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:47 2022] POST /identity/v3/users => generated 304 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:47.789124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:47.791213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:47.793557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:47.794626 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.794977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.795246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.795935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:47.796237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:47.797941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:47.807163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88114d21-fffb-4aee-952d-33c8c91bba7b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:47.812429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9256d-4c0b-4153-aed6-eefd55fa3ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:47.813383 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9256d-4c0b-4153-aed6-eefd55fa3ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.813775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9256d-4c0b-4153-aed6-eefd55fa3ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.813975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9256d-4c0b-4153-aed6-eefd55fa3ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.814869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9256d-4c0b-4153-aed6-eefd55fa3ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:47.816577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9256d-4c0b-4153-aed6-eefd55fa3ad0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:47.818594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 921/1861] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:44:47.819962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:47.831887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa22b9-1da5-42f4-97c7-2e6d0e8803b2 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:47.832032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 941/1862] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:47.836902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9256d-4c0b-4153-aed6-eefd55fa3ad0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:47.839795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc43ee1-b73f-4fba-95ca-fe5e1c652675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:47.840444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43ee1-b73f-4fba-95ca-fe5e1c652675 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.840727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43ee1-b73f-4fba-95ca-fe5e1c652675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.840994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc43ee1-b73f-4fba-95ca-fe5e1c652675 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.841645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc43ee1-b73f-4fba-95ca-fe5e1c652675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:47.843896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc43ee1-b73f-4fba-95ca-fe5e1c652675 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:47.849198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9256d-4c0b-4153-aed6-eefd55fa3ad0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:47.861868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9b266-1a94-4f91-8047-b4b3230ed180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:47.862565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b266-1a94-4f91-8047-b4b3230ed180 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.862843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b266-1a94-4f91-8047-b4b3230ed180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.863136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b266-1a94-4f91-8047-b4b3230ed180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.863884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9b266-1a94-4f91-8047-b4b3230ed180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:47.865553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9b266-1a94-4f91-8047-b4b3230ed180 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:47.878420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 942/1863] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:47.886607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 922/1864] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:47 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:47.890449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9b266-1a94-4f91-8047-b4b3230ed180 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:47.892709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc43ee1-b73f-4fba-95ca-fe5e1c652675 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:47.902770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9b266-1a94-4f91-8047-b4b3230ed180 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:47.977080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e392655-9cfa-4552-809a-54493c6661b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:47.977785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e392655-9cfa-4552-809a-54493c6661b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:47.978063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e392655-9cfa-4552-809a-54493c6661b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:47.978334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e392655-9cfa-4552-809a-54493c6661b8 admin admin] PATH_INFO: `/v3/projects/986d0cac4f924a4bbcf3e520d3d80090/users/e7e64affd2a344be84ffb7cb3e3a0cef/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:47.998199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e392655-9cfa-4552-809a-54493c6661b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986d0cac4f924a4bbcf3e520d3d80090, user_id=e7e64affd2a344be84ffb7cb3e3a0cef, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:48.011886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e392655-9cfa-4552-809a-54493c6661b8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:48.051726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 943/1865] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:47 2022] PUT /identity/v3/projects/986d0cac4f924a4bbcf3e520d3d80090/users/e7e64affd2a344be84ffb7cb3e3a0cef/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:48.056174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc43ee1-b73f-4fba-95ca-fe5e1c652675 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:48.063343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c956bc-5133-4846-ac75-6f25cf820e00 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.063625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c956bc-5133-4846-ac75-6f25cf820e00 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.064064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c956bc-5133-4846-ac75-6f25cf820e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.097580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:48.101664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-28c956bc-5133-4846-ac75-6f25cf820e00 None None] MFA Rules not processed for user `e7e64affd2a344be84ffb7cb3e3a0cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:48.117684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-28c956bc-5133-4846-ac75-6f25cf820e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:48.235442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de997b-81a0-42b0-901a-563531febb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:48.237713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de997b-81a0-42b0-901a-563531febb17 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.238012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de997b-81a0-42b0-901a-563531febb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.238283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de997b-81a0-42b0-901a-563531febb17 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.239983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de997b-81a0-42b0-901a-563531febb17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:48.243904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de997b-81a0-42b0-901a-563531febb17 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:48.293610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 944/1866] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:48 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:48.298236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c956bc-5133-4846-ac75-6f25cf820e00 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:48.303569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 923/1867] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:47 2022] POST /identity/v3/users => generated 285 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:48.308280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de997b-81a0-42b0-901a-563531febb17 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:48.315151 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c956bc-5133-4846-ac75-6f25cf820e00 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:48.325532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfaf9-2fdb-4c72-a0de-edc91e6780a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:48.326301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfaf9-2fdb-4c72-a0de-edc91e6780a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.326670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfaf9-2fdb-4c72-a0de-edc91e6780a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.327002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfaf9-2fdb-4c72-a0de-edc91e6780a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.327723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddfaf9-2fdb-4c72-a0de-edc91e6780a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:48.328044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de997b-81a0-42b0-901a-563531febb17 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:48.330669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddfaf9-2fdb-4c72-a0de-edc91e6780a2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:48.345387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae13a9-4f8c-4945-a303-a124e4c51d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:48.346587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae13a9-4f8c-4945-a303-a124e4c51d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.347031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae13a9-4f8c-4945-a303-a124e4c51d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.348970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae13a9-4f8c-4945-a303-a124e4c51d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.350175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae13a9-4f8c-4945-a303-a124e4c51d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:48.362291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae13a9-4f8c-4945-a303-a124e4c51d34 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:48.384779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 924/1868] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:48.389919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae13a9-4f8c-4945-a303-a124e4c51d34 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:48.393306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 945/1869] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:48 2022] POST /identity/v3/projects => generated 407 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:48.399002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfaf9-2fdb-4c72-a0de-edc91e6780a2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:48.411013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae13a9-4f8c-4945-a303-a124e4c51d34 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:48.450548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:48.605438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfaf9-2fdb-4c72-a0de-edc91e6780a2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:48.617915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda8cd-591b-47af-b041-cb24de8334d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:48.619429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda8cd-591b-47af-b041-cb24de8334d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.619905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda8cd-591b-47af-b041-cb24de8334d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.620379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda8cd-591b-47af-b041-cb24de8334d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.622080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda8cd-591b-47af-b041-cb24de8334d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:48.626782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda8cd-591b-47af-b041-cb24de8334d9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:48.689779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 946/1870] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:48 2022] POST /identity/v3/users => generated 310 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:48.696023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda8cd-591b-47af-b041-cb24de8334d9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:48.704233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806690ad-6d64-4a41-ac6b-ad45d0a41470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:48.705007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806690ad-6d64-4a41-ac6b-ad45d0a41470 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.705692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806690ad-6d64-4a41-ac6b-ad45d0a41470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.709867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806690ad-6d64-4a41-ac6b-ad45d0a41470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.713822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806690ad-6d64-4a41-ac6b-ad45d0a41470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:48.716035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806690ad-6d64-4a41-ac6b-ad45d0a41470 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:48.725459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda8cd-591b-47af-b041-cb24de8334d9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:48.747397 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 925/1871] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:48.750698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551e04-d8a1-4c4d-819c-368afb88d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:48.751910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806690ad-6d64-4a41-ac6b-ad45d0a41470 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:48.752267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551e04-d8a1-4c4d-819c-368afb88d526 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.752926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551e04-d8a1-4c4d-819c-368afb88d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.753405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551e04-d8a1-4c4d-819c-368afb88d526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.754890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551e04-d8a1-4c4d-819c-368afb88d526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:48.759119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551e04-d8a1-4c4d-819c-368afb88d526 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:48.792288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806690ad-6d64-4a41-ac6b-ad45d0a41470 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:48.812086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7b0e8-2efe-41cb-80ac-0ec7526d65d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:48.815177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7b0e8-2efe-41cb-80ac-0ec7526d65d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.815177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7b0e8-2efe-41cb-80ac-0ec7526d65d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.815177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7b0e8-2efe-41cb-80ac-0ec7526d65d2 admin admin] PATH_INFO: `/v3/projects/eced4d6d55134e419e8aadbe65f00a21/users/abfaa581deb04225b88af13e29b19319/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.836586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 947/1872] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:44:48.845973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551e04-d8a1-4c4d-819c-368afb88d526 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:48.886634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7b0e8-2efe-41cb-80ac-0ec7526d65d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eced4d6d55134e419e8aadbe65f00a21, user_id=abfaa581deb04225b88af13e29b19319, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:48.889916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551e04-d8a1-4c4d-819c-368afb88d526 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:48.902044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7b0e8-2efe-41cb-80ac-0ec7526d65d2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:48.910347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ddec-5ab1-4b5c-b46e-b16145b950ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:48.911503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ddec-5ab1-4b5c-b46e-b16145b950ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.911926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ddec-5ab1-4b5c-b46e-b16145b950ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.912593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ddec-5ab1-4b5c-b46e-b16145b950ba admin admin] PATH_INFO: `/v3/projects/d7af68e282c24182be9a2bbcf235c8e9/users/398723ec4e8e43cb949d342208fba8bd/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.973141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 926/1873] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:48 2022] PUT /identity/v3/projects/eced4d6d55134e419e8aadbe65f00a21/users/abfaa581deb04225b88af13e29b19319/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:48.989686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d38e-85af-47c6-9015-af2b5085d068 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:48.990159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d38e-85af-47c6-9015-af2b5085d068 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:48.990686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d38e-85af-47c6-9015-af2b5085d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:48.996935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91ddec-5ab1-4b5c-b46e-b16145b950ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7af68e282c24182be9a2bbcf235c8e9, user_id=398723ec4e8e43cb949d342208fba8bd, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:49.006654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91ddec-5ab1-4b5c-b46e-b16145b950ba admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:49.038414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 948/1874] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:48 2022] PUT /identity/v3/projects/d7af68e282c24182be9a2bbcf235c8e9/users/398723ec4e8e43cb949d342208fba8bd/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:49.046027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ddec-5ab1-4b5c-b46e-b16145b950ba admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:49.081136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-83c0d38e-85af-47c6-9015-af2b5085d068 None None] MFA Rules not processed for user `abfaa581deb04225b88af13e29b19319`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:49.083753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-83c0d38e-85af-47c6-9015-af2b5085d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:49.243253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ddec-5ab1-4b5c-b46e-b16145b950ba admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:49.262196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60c4d4-4646-4cda-9f50-f98bd8d6f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:49.262196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c4d4-4646-4cda-9f50-f98bd8d6f881 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:49.262828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c4d4-4646-4cda-9f50-f98bd8d6f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:49.263206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c4d4-4646-4cda-9f50-f98bd8d6f881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:49.264012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60c4d4-4646-4cda-9f50-f98bd8d6f881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:49.273425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60c4d4-4646-4cda-9f50-f98bd8d6f881 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:49.294912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 949/1875] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:49.303452 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60c4d4-4646-4cda-9f50-f98bd8d6f881 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:49.345049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:49.372857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60c4d4-4646-4cda-9f50-f98bd8d6f881 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:49.386294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 927/1876] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:49.388114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0d38e-85af-47c6-9015-af2b5085d068 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:49.423545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0d38e-85af-47c6-9015-af2b5085d068 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:49.428496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145efca-22e9-411e-8443-3f6baf2cd12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:49.437941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145efca-22e9-411e-8443-3f6baf2cd12d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:49.439327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145efca-22e9-411e-8443-3f6baf2cd12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:49.441072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145efca-22e9-411e-8443-3f6baf2cd12d admin admin] PATH_INFO: `/v3/projects/d7af68e282c24182be9a2bbcf235c8e9/users/398723ec4e8e43cb949d342208fba8bd/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:49.452054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858840a-95f6-4442-a52f-a255c08034d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:49.453374 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858840a-95f6-4442-a52f-a255c08034d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:49.453765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858840a-95f6-4442-a52f-a255c08034d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:49.454050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858840a-95f6-4442-a52f-a255c08034d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:49.454840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858840a-95f6-4442-a52f-a255c08034d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:49.458734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145efca-22e9-411e-8443-3f6baf2cd12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7af68e282c24182be9a2bbcf235c8e9, user_id=398723ec4e8e43cb949d342208fba8bd, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:49.460139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858840a-95f6-4442-a52f-a255c08034d4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:49.488260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145efca-22e9-411e-8443-3f6baf2cd12d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:49.538853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 950/1877] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:49 2022] PUT /identity/v3/projects/d7af68e282c24182be9a2bbcf235c8e9/users/398723ec4e8e43cb949d342208fba8bd/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:49.557365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5f72-309b-4560-8c46-770c458666a8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:49.558199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5f72-309b-4560-8c46-770c458666a8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:49.558700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a5f72-309b-4560-8c46-770c458666a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:49.562320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 928/1878] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:49 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:49.563791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858840a-95f6-4442-a52f-a255c08034d4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:49.613191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fa7a5f72-309b-4560-8c46-770c458666a8 None None] MFA Rules not processed for user `398723ec4e8e43cb949d342208fba8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:49.615576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fa7a5f72-309b-4560-8c46-770c458666a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:49.669964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858840a-95f6-4442-a52f-a255c08034d4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:49.675872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b5028-dffd-4a3e-b323-cdc100ac0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:49.676732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5028-dffd-4a3e-b323-cdc100ac0751 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:49.677356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5028-dffd-4a3e-b323-cdc100ac0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:49.677688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5028-dffd-4a3e-b323-cdc100ac0751 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:49.679170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b5028-dffd-4a3e-b323-cdc100ac0751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:49.681579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b5028-dffd-4a3e-b323-cdc100ac0751 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:49.686853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:49.724277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 929/1879] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:49 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:49.725895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b5028-dffd-4a3e-b323-cdc100ac0751 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:49.740965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b5028-dffd-4a3e-b323-cdc100ac0751 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:49.761591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deb5ba-e10d-452f-a7c6-ac9df7a05c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:49.762717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deb5ba-e10d-452f-a7c6-ac9df7a05c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:49.763251 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deb5ba-e10d-452f-a7c6-ac9df7a05c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:49.763556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deb5ba-e10d-452f-a7c6-ac9df7a05c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:49.764708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deb5ba-e10d-452f-a7c6-ac9df7a05c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:49.767534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deb5ba-e10d-452f-a7c6-ac9df7a05c6e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:49.795273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 951/1880] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:49 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:49.814341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a5f72-309b-4560-8c46-770c458666a8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:49.817616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fa7a5f72-309b-4560-8c46-770c458666a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:49.829457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 930/1881] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:49.829457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deb5ba-e10d-452f-a7c6-ac9df7a05c6e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:49.841632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deb5ba-e10d-452f-a7c6-ac9df7a05c6e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:49.849457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779d10b-aa0e-46c9-9e27-e676c63f9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:49.849936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779d10b-aa0e-46c9-9e27-e676c63f9dec admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:49.850221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779d10b-aa0e-46c9-9e27-e676c63f9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:49.850824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779d10b-aa0e-46c9-9e27-e676c63f9dec admin admin] PATH_INFO: `/v3/projects/975c0ef8e92d4fe9b2d1958c318d318c/users/3e5aa3f6af494c3d8fccc0ab6b688268/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:49.884213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779d10b-aa0e-46c9-9e27-e676c63f9dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=975c0ef8e92d4fe9b2d1958c318d318c, user_id=3e5aa3f6af494c3d8fccc0ab6b688268, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:49.898061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779d10b-aa0e-46c9-9e27-e676c63f9dec admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:49.926447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 931/1882] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:49 2022] PUT /identity/v3/projects/975c0ef8e92d4fe9b2d1958c318d318c/users/3e5aa3f6af494c3d8fccc0ab6b688268/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:49.932426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779d10b-aa0e-46c9-9e27-e676c63f9dec admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:49.955551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a5f72-309b-4560-8c46-770c458666a8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:50.064540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779d10b-aa0e-46c9-9e27-e676c63f9dec admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:50.075101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9812e-b509-4ae5-8f50-93c2f5366558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:50.076581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9812e-b509-4ae5-8f50-93c2f5366558 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:50.077962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9812e-b509-4ae5-8f50-93c2f5366558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:50.078900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9812e-b509-4ae5-8f50-93c2f5366558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:50.080529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9812e-b509-4ae5-8f50-93c2f5366558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:50.084206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9812e-b509-4ae5-8f50-93c2f5366558 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:50.099878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5bbea-91b2-4ce4-b90c-e773162e363a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:50.103045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bbea-91b2-4ce4-b90c-e773162e363a service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:50.103697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bbea-91b2-4ce4-b90c-e773162e363a service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:50.104305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bbea-91b2-4ce4-b90c-e773162e363a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:50.110562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 932/1883] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:44:50.120647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9812e-b509-4ae5-8f50-93c2f5366558 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:50.141423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9812e-b509-4ae5-8f50-93c2f5366558 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:50.152177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59095f-4cb2-4a2e-b3bd-44c73837c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:50.153519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59095f-4cb2-4a2e-b3bd-44c73837c189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:50.154477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59095f-4cb2-4a2e-b3bd-44c73837c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:50.155058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59095f-4cb2-4a2e-b3bd-44c73837c189 admin admin] PATH_INFO: `/v3/projects/975c0ef8e92d4fe9b2d1958c318d318c/users/3e5aa3f6af494c3d8fccc0ab6b688268/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:50.161915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59095f-4cb2-4a2e-b3bd-44c73837c189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=975c0ef8e92d4fe9b2d1958c318d318c, user_id=3e5aa3f6af494c3d8fccc0ab6b688268, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:50.169431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59095f-4cb2-4a2e-b3bd-44c73837c189 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:50.235473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5bbea-91b2-4ce4-b90c-e773162e363a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:50.236976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5bbea-91b2-4ce4-b90c-e773162e363a service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:50.240287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 933/1884] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:50 2022] PUT /identity/v3/projects/975c0ef8e92d4fe9b2d1958c318d318c/users/3e5aa3f6af494c3d8fccc0ab6b688268/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:50.254958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a39fc-813d-4922-845c-c5d903611cc1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:50.255500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a39fc-813d-4922-845c-c5d903611cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:50.256044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a39fc-813d-4922-845c-c5d903611cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:50.279859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 952/1885] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:49 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:44:50.369499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:50.376185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-852a39fc-813d-4922-845c-c5d903611cc1 None None] MFA Rules not processed for user `3e5aa3f6af494c3d8fccc0ab6b688268`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:50.380687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-852a39fc-813d-4922-845c-c5d903611cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:50.554218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 934/1886] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:50.715429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5bbea-91b2-4ce4-b90c-e773162e363a service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:50.725440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5bbea-91b2-4ce4-b90c-e773162e363a service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:50.776531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:50.811763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a39fc-813d-4922-845c-c5d903611cc1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:50.814170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-852a39fc-813d-4922-845c-c5d903611cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:50.814320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:50.815118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:50.815614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:50.815876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:50.827513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:50.829367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a39fc-813d-4922-845c-c5d903611cc1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:50.830270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:50.834915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add2e75-876b-49e4-bb09-7876c5b44c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:50.835526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2e75-876b-49e4-bb09-7876c5b44c33 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:50.835800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2e75-876b-49e4-bb09-7876c5b44c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:50.836070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add2e75-876b-49e4-bb09-7876c5b44c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:50.850022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 953/1887] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:50.956898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add2e75-876b-49e4-bb09-7876c5b44c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:50.961051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add2e75-876b-49e4-bb09-7876c5b44c33 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:51.002935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 935/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:50 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:44:51.693457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:51.695596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:51.842963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70d3de-4184-417f-a629-7cc68b599984 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:51.853123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:51.853802 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:51.854338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:51.854653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] PATH_INFO: `/v3/users/0c19288fe5744e38ade1e4b47a4af1f9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:51.855946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c19288fe5744e38ade1e4b47a4af1f9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:51.858269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:51.942898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c19288fe5744e38ade1e4b47a4af1f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:51.971762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c19288fe5744e38ade1e4b47a4af1f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:51.972607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c19288fe5744e38ade1e4b47a4af1f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:51.973963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c19288fe5744e38ade1e4b47a4af1f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:52.016491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c19288fe5744e38ade1e4b47a4af1f9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:52.049766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 954/1889] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:51 2022] DELETE /identity/v3/users/0c19288fe5744e38ade1e4b47a4af1f9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:52.056459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35ce6-7eb2-4965-83a0-ac5a080f7b83 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:52.057326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35ce6-7eb2-4965-83a0-ac5a080f7b83 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:52.057326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35ce6-7eb2-4965-83a0-ac5a080f7b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:52.103348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d9c35ce6-7eb2-4965-83a0-ac5a080f7b83 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:52.104968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d9c35ce6-7eb2-4965-83a0-ac5a080f7b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:52.215952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 936/1890] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:52.224424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:52.226608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:52.336401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba28b5-3425-411f-909b-9e1ad886715f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:52.340704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1de3b-7734-456f-99b6-8daab0bbb5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:52.341720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1de3b-7734-456f-99b6-8daab0bbb5dc service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:52.342076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1de3b-7734-456f-99b6-8daab0bbb5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:52.342619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1de3b-7734-456f-99b6-8daab0bbb5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:52.355072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1de3b-7734-456f-99b6-8daab0bbb5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:52.356691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1de3b-7734-456f-99b6-8daab0bbb5dc service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:52.369997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 955/1891] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:52.957125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35ce6-7eb2-4965-83a0-ac5a080f7b83 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:52.959311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d9c35ce6-7eb2-4965-83a0-ac5a080f7b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:52.988993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35ce6-7eb2-4965-83a0-ac5a080f7b83 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:53.008536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:53.010234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:53.010933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:53.012168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] PATH_INFO: `/v3/projects/ba6a655700694f16bc12766e67a89044` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:53.015882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6a655700694f16bc12766e67a89044)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:53.020836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:53.153441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:53.213956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6a655700694f16bc12766e67a89044', 'request_id': 'req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.237014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6a655700694f16bc12766e67a89044', 'request_id': 'req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.255907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6a655700694f16bc12766e67a89044', 'request_id': 'req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.277446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] The token cache is being invalidate because project ba6a655700694f16bc12766e67a89044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:53.277446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.278065 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.289284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 937/1892] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:52 2022] DELETE /identity/v3/projects/ba6a655700694f16bc12766e67a89044 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:53.293968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1de3b-7734-456f-99b6-8daab0bbb5dc service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:53.307804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:53.324993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1de3b-7734-456f-99b6-8daab0bbb5dc service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:53.573072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:53.574364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:53.575334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:53.575952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] PATH_INFO: `/v3/users/0cfaacc5b7954764a5be540e8f0a9891` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:53.578794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cfaacc5b7954764a5be540e8f0a9891)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:53.581915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:53.691845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cfaacc5b7954764a5be540e8f0a9891'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.724280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cfaacc5b7954764a5be540e8f0a9891'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.724280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cfaacc5b7954764a5be540e8f0a9891'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.724280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cfaacc5b7954764a5be540e8f0a9891'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.747494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ebfcda19-6e1a-4a9e-8494-601ebcb7132d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cfaacc5b7954764a5be540e8f0a9891'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:53.767012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 956/1893] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:53 2022] DELETE /identity/v3/users/0cfaacc5b7954764a5be540e8f0a9891 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:54.560268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:54.562528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:54.607848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aed0dc-6be1-4b3d-911f-f3f6df6c0ba3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:54.740540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:54.741702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:54.742591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:54.743033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] PATH_INFO: `/v3/projects/a1078f587edb46c6ac9c36f1370500ac` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:54.744884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1078f587edb46c6ac9c36f1370500ac)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:54.747682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:54.936003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1078f587edb46c6ac9c36f1370500ac', 'request_id': 'req-23d7ff9a-9f24-4bbc-8ad5-211946268227'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:54.958599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1078f587edb46c6ac9c36f1370500ac', 'request_id': 'req-23d7ff9a-9f24-4bbc-8ad5-211946268227'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:54.976319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1078f587edb46c6ac9c36f1370500ac', 'request_id': 'req-23d7ff9a-9f24-4bbc-8ad5-211946268227'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:55.003342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] The token cache is being invalidate because project a1078f587edb46c6ac9c36f1370500ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:55.004069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:55.013534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:55.023892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 938/1894] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:54 2022] DELETE /identity/v3/projects/a1078f587edb46c6ac9c36f1370500ac => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:55.026112 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954424-388c-420b-8e49-3522dbda239b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:55.026929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954424-388c-420b-8e49-3522dbda239b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:55.027128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954424-388c-420b-8e49-3522dbda239b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:55.092364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-da954424-388c-420b-8e49-3522dbda239b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:55.103697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-da954424-388c-420b-8e49-3522dbda239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:55.146517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:55.149709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:55.339001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 957/1895] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:55.352984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fc263-e69b-4421-8d28-b5929be09a5f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:55.353513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fc263-e69b-4421-8d28-b5929be09a5f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:55.353941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fc263-e69b-4421-8d28-b5929be09a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:55.395153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-956fc263-e69b-4421-8d28-b5929be09a5f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:55.404209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:55.411016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-956fc263-e69b-4421-8d28-b5929be09a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:55.447762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 958/1896] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:55.449310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fc263-e69b-4421-8d28-b5929be09a5f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:55.458256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7ff9a-9f24-4bbc-8ad5-211946268227 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:55.471069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fc263-e69b-4421-8d28-b5929be09a5f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:55.482825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:55.484434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:55.485310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:55.486260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:55.487963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:55.488842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:55.492710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:55.507445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:55.508981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:55.509624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:55.510034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] PATH_INFO: `/v3/users/abfaa581deb04225b88af13e29b19319` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:55.515415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfaa581deb04225b88af13e29b19319)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:55.518967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:55.531624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 959/1897] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:44:55.533601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:55.556054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:55.587016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe61ce2-25ca-405e-9e47-0a5c260cb367 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:55.597427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033112-eb17-41e1-8c45-85b0cbb47476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:55.599810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033112-eb17-41e1-8c45-85b0cbb47476 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:55.602412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033112-eb17-41e1-8c45-85b0cbb47476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:55.603069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033112-eb17-41e1-8c45-85b0cbb47476 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:55.604952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86033112-eb17-41e1-8c45-85b0cbb47476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:55.609304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86033112-eb17-41e1-8c45-85b0cbb47476 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:55.683335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 960/1898] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:55 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:55.689602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033112-eb17-41e1-8c45-85b0cbb47476 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:55.710780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfaa581deb04225b88af13e29b19319'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:55.758739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfaa581deb04225b88af13e29b19319'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:55.777768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfaa581deb04225b88af13e29b19319'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:55.779063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfaa581deb04225b88af13e29b19319'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:55.780546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4a26d034-d2b5-4eee-b814-0c02ab27c06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfaa581deb04225b88af13e29b19319'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:55.857131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 939/1899] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:55 2022] DELETE /identity/v3/users/abfaa581deb04225b88af13e29b19319 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:55.862638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd853461-a418-4f8d-aefa-d23977ae7ef9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:55.862638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd853461-a418-4f8d-aefa-d23977ae7ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:55.862638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd853461-a418-4f8d-aefa-d23977ae7ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:55.864310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033112-eb17-41e1-8c45-85b0cbb47476 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:55.894797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-dd853461-a418-4f8d-aefa-d23977ae7ef9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:55.896073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dd853461-a418-4f8d-aefa-d23977ae7ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:55.997976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 940/1900] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:56.011269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:56.011511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:56.011847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:56.012118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:56.012797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:56.015145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:56.027768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd853461-a418-4f8d-aefa-d23977ae7ef9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:56.029419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dd853461-a418-4f8d-aefa-d23977ae7ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:56.093688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 961/1901] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:55 2022] POST /identity/v3/users => generated 290 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:44:56.097076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:56.107274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:56.145894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae253-de49-41c2-b345-b7c733ac7bc3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:56.156709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd853461-a418-4f8d-aefa-d23977ae7ef9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:56.161766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcc9fb-338f-4fb7-bbe6-b0b53bbd996c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:56.162453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc9fb-338f-4fb7-bbe6-b0b53bbd996c service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:56.162799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc9fb-338f-4fb7-bbe6-b0b53bbd996c service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:56.163210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc9fb-338f-4fb7-bbe6-b0b53bbd996c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:56.165509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9de8d-a5ef-4af5-b991-93273cd2543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:56.166772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9de8d-a5ef-4af5-b991-93273cd2543d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:56.167255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9de8d-a5ef-4af5-b991-93273cd2543d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:56.167735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9de8d-a5ef-4af5-b991-93273cd2543d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:56.168953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9de8d-a5ef-4af5-b991-93273cd2543d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:56.172427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9de8d-a5ef-4af5-b991-93273cd2543d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:56.180880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcc9fb-338f-4fb7-bbe6-b0b53bbd996c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:56.182967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcc9fb-338f-4fb7-bbe6-b0b53bbd996c service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:56.199172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 941/1902] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:56.200160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 962/1903] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:56.201292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcc9fb-338f-4fb7-bbe6-b0b53bbd996c service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:56.215059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcc9fb-338f-4fb7-bbe6-b0b53bbd996c service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:56.233515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fc5ea-ed62-449f-a45b-7fdba3f0ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:56.234753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fc5ea-ed62-449f-a45b-7fdba3f0ec07 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:56.235261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fc5ea-ed62-449f-a45b-7fdba3f0ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:56.235822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fc5ea-ed62-449f-a45b-7fdba3f0ec07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:56.237277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fc5ea-ed62-449f-a45b-7fdba3f0ec07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:56.240487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fc5ea-ed62-449f-a45b-7fdba3f0ec07 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:56.261143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 942/1904] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:56.266044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9de8d-a5ef-4af5-b991-93273cd2543d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:56.282453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9de8d-a5ef-4af5-b991-93273cd2543d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:56.291018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:56.292535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:56.292535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:56.292974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] PATH_INFO: `/v3/projects/0b849db863cc46eb97302d7d32edca7c/users/fdd90b1468c44fd1b0f5e5f9f7c31fe1/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:56.343879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b849db863cc46eb97302d7d32edca7c, user_id=fdd90b1468c44fd1b0f5e5f9f7c31fe1, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:56.347743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:56.394490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 963/1905] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:56 2022] PUT /identity/v3/projects/0b849db863cc46eb97302d7d32edca7c/users/fdd90b1468c44fd1b0f5e5f9f7c31fe1/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:56.400920 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd8295-d067-4277-8b2c-f571f825287e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:56.402243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd8295-d067-4277-8b2c-f571f825287e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:56.403107 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd8295-d067-4277-8b2c-f571f825287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:56.421906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:56.476111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-53bd8295-d067-4277-8b2c-f571f825287e None None] MFA Rules not processed for user `fdd90b1468c44fd1b0f5e5f9f7c31fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:56.478437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-53bd8295-d067-4277-8b2c-f571f825287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:56.710116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:56.713953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:56.840765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 943/1906] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:56.861074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd8295-d067-4277-8b2c-f571f825287e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:56.921463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:57.026186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c2be7-eb58-4808-8aef-012adedefaef admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:57.049902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:57.050784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:57.051294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:57.051444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] PATH_INFO: `/v3/projects/eced4d6d55134e419e8aadbe65f00a21` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:57.052734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eced4d6d55134e419e8aadbe65f00a21)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:57.055952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:57.136897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd8295-d067-4277-8b2c-f571f825287e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:57.162789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3c1e4-0002-41ae-865d-8f6bfda721b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:57.164750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c1e4-0002-41ae-865d-8f6bfda721b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:57.166011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c1e4-0002-41ae-865d-8f6bfda721b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:57.167334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c1e4-0002-41ae-865d-8f6bfda721b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:57.168206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3c1e4-0002-41ae-865d-8f6bfda721b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:57.170412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3c1e4-0002-41ae-865d-8f6bfda721b5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:57.292639 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eced4d6d55134e419e8aadbe65f00a21', 'request_id': 'req-67227d6a-4e1e-4653-8541-efa552b672a8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.304887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 944/1907] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:56 2022] POST /identity/v3/projects => generated 377 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:57.310702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3c1e4-0002-41ae-865d-8f6bfda721b5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:57.320723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eced4d6d55134e419e8aadbe65f00a21', 'request_id': 'req-67227d6a-4e1e-4653-8541-efa552b672a8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.358003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eced4d6d55134e419e8aadbe65f00a21', 'request_id': 'req-67227d6a-4e1e-4653-8541-efa552b672a8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.392345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] The token cache is being invalidate because project eced4d6d55134e419e8aadbe65f00a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:57.392708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.393446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.399444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 964/1908] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:56 2022] DELETE /identity/v3/projects/eced4d6d55134e419e8aadbe65f00a21 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:44:57.401219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:57.404792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:57.492748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3c1e4-0002-41ae-865d-8f6bfda721b5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:57.507378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:57.507378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:57.507378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:57.507378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:57.508137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:57.515272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:57.575328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67227d6a-4e1e-4653-8541-efa552b672a8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:57.582488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:57.583699 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:57.584079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:57.584529 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] PATH_INFO: `/v3/users/3e5aa3f6af494c3d8fccc0ab6b688268` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:57.586526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5aa3f6af494c3d8fccc0ab6b688268)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:57.589069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:57.590686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 945/1909] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:57 2022] POST /identity/v3/users => generated 295 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:57.597597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:57.604561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:57.634880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba092107-63da-4edd-8b74-55e951709c91 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:57.641512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c248d6-e9ef-424c-90b6-20985517ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:57.642281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c248d6-e9ef-424c-90b6-20985517ba45 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:57.642646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c248d6-e9ef-424c-90b6-20985517ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:57.643000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c248d6-e9ef-424c-90b6-20985517ba45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:57.644109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c248d6-e9ef-424c-90b6-20985517ba45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:57.645994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c248d6-e9ef-424c-90b6-20985517ba45 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:57.649671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:57.665995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 946/1910] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:57.667256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c248d6-e9ef-424c-90b6-20985517ba45 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:57.685111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c248d6-e9ef-424c-90b6-20985517ba45 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:57.690678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:57.691978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:57.692284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:57.692528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] PATH_INFO: `/v3/projects/2dae4db77d324878872a6e4c0a601651/users/7fb21ec24bd044db93b05aeed19c45cc/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:57.711091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5aa3f6af494c3d8fccc0ab6b688268'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.716788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dae4db77d324878872a6e4c0a601651, user_id=7fb21ec24bd044db93b05aeed19c45cc, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:57.719741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:57.737862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 947/1911] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:57 2022] PUT /identity/v3/projects/2dae4db77d324878872a6e4c0a601651/users/7fb21ec24bd044db93b05aeed19c45cc/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:57.740984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5aa3f6af494c3d8fccc0ab6b688268'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.740984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5aa3f6af494c3d8fccc0ab6b688268'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.742200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5aa3f6af494c3d8fccc0ab6b688268'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.743032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:57.744965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:57.759951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5aa3f6af494c3d8fccc0ab6b688268'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:57.776491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:57.827790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 965/1912] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:57 2022] DELETE /identity/v3/users/3e5aa3f6af494c3d8fccc0ab6b688268 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:57.931226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70258f18-e00d-4d01-bc92-6156445c90a4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:58.059650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea13a02-1783-4abc-bfaa-b6ed043494ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:58.061529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea13a02-1783-4abc-bfaa-b6ed043494ff admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:58.062158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea13a02-1783-4abc-bfaa-b6ed043494ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:58.062890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea13a02-1783-4abc-bfaa-b6ed043494ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:58.064645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea13a02-1783-4abc-bfaa-b6ed043494ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:58.067840 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea13a02-1783-4abc-bfaa-b6ed043494ff admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:58.090439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 948/1913] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:44:58.094109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:58.113315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc7a6-5a8e-48cf-a3f1-93c946fc73ce admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:58.122255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:58.123836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:58.124340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:58.124825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] PATH_INFO: `/v3/projects/2dae4db77d324878872a6e4c0a601651/users/7fb21ec24bd044db93b05aeed19c45cc/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:58.130066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dae4db77d324878872a6e4c0a601651, user_id=7fb21ec24bd044db93b05aeed19c45cc, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:58.157563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:58.198337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 966/1914] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:58 2022] PUT /identity/v3/projects/2dae4db77d324878872a6e4c0a601651/users/7fb21ec24bd044db93b05aeed19c45cc/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:58.220141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708deae8-15f2-49ed-b3a0-889eab85afea None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:58.220581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708deae8-15f2-49ed-b3a0-889eab85afea None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:58.221026 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708deae8-15f2-49ed-b3a0-889eab85afea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:58.276689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-708deae8-15f2-49ed-b3a0-889eab85afea None None] MFA Rules not processed for user `7fb21ec24bd044db93b05aeed19c45cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:58.279560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-708deae8-15f2-49ed-b3a0-889eab85afea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:58.480441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:58.483261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:58.539119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:58.549192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 949/1915] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:58.603180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708deae8-15f2-49ed-b3a0-889eab85afea None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:58.605560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-708deae8-15f2-49ed-b3a0-889eab85afea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:58.668036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c992cc-21df-4ea9-aaea-29886922d8e0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:58.684006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:58.685138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:58.685525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:58.686440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] PATH_INFO: `/v3/projects/975c0ef8e92d4fe9b2d1958c318d318c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:58.689964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=975c0ef8e92d4fe9b2d1958c318d318c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:58.696910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:58.727783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708deae8-15f2-49ed-b3a0-889eab85afea None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:58.738415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:58.739171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:58.739449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:58.739721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:58.745473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:58.826824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975c0ef8e92d4fe9b2d1958c318d318c', 'request_id': 'req-08a3836b-1a64-4650-b75f-25148c6c5f5d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:58.838896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975c0ef8e92d4fe9b2d1958c318d318c', 'request_id': 'req-08a3836b-1a64-4650-b75f-25148c6c5f5d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:58.851139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975c0ef8e92d4fe9b2d1958c318d318c', 'request_id': 'req-08a3836b-1a64-4650-b75f-25148c6c5f5d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:58.872925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:58.875359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:58.884231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] The token cache is being invalidate because project 975c0ef8e92d4fe9b2d1958c318d318c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:44:58.885623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:58.887175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-08a3836b-1a64-4650-b75f-25148c6c5f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:58.892390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 950/1916] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:44:58.893085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:58.894485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 967/1917] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:44:58 2022] DELETE /identity/v3/projects/975c0ef8e92d4fe9b2d1958c318d318c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:58.899837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:58.901889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb44e-e9af-414c-a487-8a28ed9797bb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:58.903023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb44e-e9af-414c-a487-8a28ed9797bb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:58.903796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb44e-e9af-414c-a487-8a28ed9797bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:58.936408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f38c0-6352-4931-ae25-355c9a013807 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:58.955559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1b6bb44e-e9af-414c-a487-8a28ed9797bb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:58.959503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1b6bb44e-e9af-414c-a487-8a28ed9797bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:59.133418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:59.135261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.135658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.136634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] PATH_INFO: `/v3/users/e7e64affd2a344be84ffb7cb3e3a0cef` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.138422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e64affd2a344be84ffb7cb3e3a0cef)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:59.140995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:59.147109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 968/1918] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:59.157012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44591cb0-63c5-4b52-9a5d-43df06f3b512 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.157903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44591cb0-63c5-4b52-9a5d-43df06f3b512 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.158485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44591cb0-63c5-4b52-9a5d-43df06f3b512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.187924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-44591cb0-63c5-4b52-9a5d-43df06f3b512 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:59.189259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-44591cb0-63c5-4b52-9a5d-43df06f3b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:59.209132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 969/1919] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:44:59.214908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44591cb0-63c5-4b52-9a5d-43df06f3b512 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:59.220801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:59.227926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44591cb0-63c5-4b52-9a5d-43df06f3b512 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:59.235159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:59.236232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.237311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.237842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.238867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:44:59.239390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:59.241591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:59.243870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e64affd2a344be84ffb7cb3e3a0cef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:59.262147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 970/1920] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:44:59.266560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:59.267872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:59.283193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e64affd2a344be84ffb7cb3e3a0cef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:59.289607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d602-13e4-4ea4-a11c-9b9a3541f45a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:59.300678 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e64affd2a344be84ffb7cb3e3a0cef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:59.302812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e64affd2a344be84ffb7cb3e3a0cef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:59.304491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-661ce1f4-2984-45e5-ac31-bacca6004edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e64affd2a344be84ffb7cb3e3a0cef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:44:59.304684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:59.306460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.306754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.307039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.308906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:59.310936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:59.365163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 951/1921] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:44:58 2022] DELETE /identity/v3/users/e7e64affd2a344be84ffb7cb3e3a0cef => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:59.372409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f3c2f-565c-4849-a6f9-68a0acf821b8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.372771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f3c2f-565c-4849-a6f9-68a0acf821b8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.373313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f3c2f-565c-4849-a6f9-68a0acf821b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.392036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 971/1922] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:44:59 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:44:59.393820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:59.399115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:59.451731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b55f3c2f-565c-4849-a6f9-68a0acf821b8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:59.455696 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b55f3c2f-565c-4849-a6f9-68a0acf821b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:59.551973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f093-5499-476f-ba5a-b7e979b8a163 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:59.559537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58d74b-c0a6-4189-bba2-e4c9590c06b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:59.560493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58d74b-c0a6-4189-bba2-e4c9590c06b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.561060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58d74b-c0a6-4189-bba2-e4c9590c06b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.561513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58d74b-c0a6-4189-bba2-e4c9590c06b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.562442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58d74b-c0a6-4189-bba2-e4c9590c06b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:59.565004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58d74b-c0a6-4189-bba2-e4c9590c06b6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:59.597009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 972/1923] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:44:59 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:44:59.601890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58d74b-c0a6-4189-bba2-e4c9590c06b6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:59.616147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58d74b-c0a6-4189-bba2-e4c9590c06b6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:59.621671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30552c-11a0-401b-a376-026d2ed71804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:59.622538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30552c-11a0-401b-a376-026d2ed71804 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.622977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30552c-11a0-401b-a376-026d2ed71804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.623347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30552c-11a0-401b-a376-026d2ed71804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.624323 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30552c-11a0-401b-a376-026d2ed71804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:59.626619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30552c-11a0-401b-a376-026d2ed71804 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:59.639899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 973/1924] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:59.645067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30552c-11a0-401b-a376-026d2ed71804 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:59.661657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30552c-11a0-401b-a376-026d2ed71804 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:59.669971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6b616-093a-42d5-98ca-6d7fb8eacf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:59.672752 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6b616-093a-42d5-98ca-6d7fb8eacf8e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.674609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6b616-093a-42d5-98ca-6d7fb8eacf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.674609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6b616-093a-42d5-98ca-6d7fb8eacf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.675763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6b616-093a-42d5-98ca-6d7fb8eacf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:59.696569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6b616-093a-42d5-98ca-6d7fb8eacf8e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:59.696985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 952/1925] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:44:59.696985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f3c2f-565c-4849-a6f9-68a0acf821b8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:59.701604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b55f3c2f-565c-4849-a6f9-68a0acf821b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:59.730497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 974/1926] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:44:59.731470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6b616-093a-42d5-98ca-6d7fb8eacf8e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:44:59.745899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6b616-093a-42d5-98ca-6d7fb8eacf8e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:59.753514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069c85-b140-4637-b185-9cd492206b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:59.754551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069c85-b140-4637-b185-9cd492206b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.754909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069c85-b140-4637-b185-9cd492206b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.755467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069c85-b140-4637-b185-9cd492206b46 admin admin] PATH_INFO: `/v3/projects/3eb4746b9c96458cb1e9aff610f46085/users/4d3a8fa510a7486eb101d8c20cf5909d/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.799644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee069c85-b140-4637-b185-9cd492206b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb4746b9c96458cb1e9aff610f46085, user_id=4d3a8fa510a7486eb101d8c20cf5909d, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:44:59.807708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee069c85-b140-4637-b185-9cd492206b46 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:44:59.834966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 975/1927] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:44:59 2022] PUT /identity/v3/projects/3eb4746b9c96458cb1e9aff610f46085/users/4d3a8fa510a7486eb101d8c20cf5909d/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:44:59.848676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828da21-5e90-413c-b79b-96fad9fc7a4e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.849149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828da21-5e90-413c-b79b-96fad9fc7a4e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.849624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828da21-5e90-413c-b79b-96fad9fc7a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:44:59.869350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f3c2f-565c-4849-a6f9-68a0acf821b8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:44:59.901854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3828da21-5e90-413c-b79b-96fad9fc7a4e None None] MFA Rules not processed for user `4d3a8fa510a7486eb101d8c20cf5909d`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:44:59.903370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3828da21-5e90-413c-b79b-96fad9fc7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:44:59.973772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2f393-963f-4d16-9382-0293d220f152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:44:59.976511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f393-963f-4d16-9382-0293d220f152 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:44:59.977299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f393-963f-4d16-9382-0293d220f152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:44:59.977750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f393-963f-4d16-9382-0293d220f152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:00.036561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:00.043309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 976/1928] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:44:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:00.045190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828da21-5e90-413c-b79b-96fad9fc7a4e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:00.053245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3828da21-5e90-413c-b79b-96fad9fc7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:00.079110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:00.143324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2f393-963f-4d16-9382-0293d220f152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:00.144852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2f393-963f-4d16-9382-0293d220f152 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:00.164679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 953/1929] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:00.180845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2f393-963f-4d16-9382-0293d220f152 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:00.209788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828da21-5e90-413c-b79b-96fad9fc7a4e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:00.211188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2f393-963f-4d16-9382-0293d220f152 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:00.218932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:00.219678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:00.219959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:00.220235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] PATH_INFO: `/v3/users/c3c6fc52171343a9a9b29f57ea2c41e1` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:00.223142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9421b-e373-45f1-b88e-cd93aa5d0472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:00.226675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9421b-e373-45f1-b88e-cd93aa5d0472 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:00.226990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9421b-e373-45f1-b88e-cd93aa5d0472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:00.227225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9421b-e373-45f1-b88e-cd93aa5d0472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:00.227762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c6fc52171343a9a9b29f57ea2c41e1)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:00.227938 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9421b-e373-45f1-b88e-cd93aa5d0472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:00.229872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9421b-e373-45f1-b88e-cd93aa5d0472 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:00.230048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:00.292691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 954/1930] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:00 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:00.294613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9421b-e373-45f1-b88e-cd93aa5d0472 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:00.367251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c6fc52171343a9a9b29f57ea2c41e1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:00.397504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c6fc52171343a9a9b29f57ea2c41e1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:00.399267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c6fc52171343a9a9b29f57ea2c41e1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:00.400318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c6fc52171343a9a9b29f57ea2c41e1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:00.411045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9421b-e373-45f1-b88e-cd93aa5d0472 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:00.419051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:00.419763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:00.420068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:00.420378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:00.422138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:00.424106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:00.425787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-42689ebd-05b7-4b37-aa38-704dba436f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c6fc52171343a9a9b29f57ea2c41e1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:00.454790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 955/1931] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:00 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:00.459681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:00.464791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 977/1932] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:00 2022] DELETE /identity/v3/users/c3c6fc52171343a9a9b29f57ea2c41e1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:00.465094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:00.467788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2565a-0fb8-456e-acc6-0bb9a116eab4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:00.468428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2565a-0fb8-456e-acc6-0bb9a116eab4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:00.468428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2565a-0fb8-456e-acc6-0bb9a116eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:00.497905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba0cba-e491-482d-83b7-5f3f49ba697c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:00.506243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-21e2565a-0fb8-456e-acc6-0bb9a116eab4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:00.508037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-21e2565a-0fb8-456e-acc6-0bb9a116eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:00.695091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 978/1933] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:00.733550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:00.735046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:00.735587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:00.736259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:00.738083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:00.745313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2565a-0fb8-456e-acc6-0bb9a116eab4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:00.747050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-21e2565a-0fb8-456e-acc6-0bb9a116eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:00.754015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:00.796523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 956/1934] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:00.801476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:00.810912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:00.820304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:01.015632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2565a-0fb8-456e-acc6-0bb9a116eab4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:01.024303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef4d20-0b4d-47f0-9ae6-0661d55829ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:01.025293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef4d20-0b4d-47f0-9ae6-0661d55829ac service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:01.025788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef4d20-0b4d-47f0-9ae6-0661d55829ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:01.026268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef4d20-0b4d-47f0-9ae6-0661d55829ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:01.031886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:01.043307 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef4d20-0b4d-47f0-9ae6-0661d55829ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:01.044973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef4d20-0b4d-47f0-9ae6-0661d55829ac service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:01.068893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e46d1-5c9c-47e9-8d09-3c2e85804514 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:01.078786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:01.079500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:01.079782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:01.080054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:01.082464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:01.096431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 979/1935] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:01.098537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef4d20-0b4d-47f0-9ae6-0661d55829ac service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:01.122713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef4d20-0b4d-47f0-9ae6-0661d55829ac service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:01.144723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:01.146590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:01.148238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:01.148984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] PATH_INFO: `/v3/projects/a4f840a9461c41adbfafae9b7a34cbe8/users/0331f78382b44fe8abdd94ca5bff3c87/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:01.181988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f840a9461c41adbfafae9b7a34cbe8, user_id=0331f78382b44fe8abdd94ca5bff3c87, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:01.185584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:01.208122 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 980/1936] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:01 2022] PUT /identity/v3/projects/a4f840a9461c41adbfafae9b7a34cbe8/users/0331f78382b44fe8abdd94ca5bff3c87/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:01.209807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:01.212142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:01.262756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:01.265672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:01.282039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 957/1937] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:01.299489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:01.333689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332250e-4d3f-4fdd-81c2-98c01b7ac9d0 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:01.344861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068345ab-3d13-46e9-bbbd-e1e13fb1743c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:01.345173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff70aad-9e75-41bb-8398-5776e76d2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:01.345827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70aad-9e75-41bb-8398-5776e76d2ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:01.348156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70aad-9e75-41bb-8398-5776e76d2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:01.348498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70aad-9e75-41bb-8398-5776e76d2ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:01.349207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff70aad-9e75-41bb-8398-5776e76d2ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:01.352379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:01.353172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:01.353635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:01.354010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] PATH_INFO: `/v3/projects/986d0cac4f924a4bbcf3e520d3d80090` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:01.356183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] RBAC: Authorizing `identity:delete_project(project_id=986d0cac4f924a4bbcf3e520d3d80090)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:01.357407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff70aad-9e75-41bb-8398-5776e76d2ccd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:01.360312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:01.381575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 958/1938] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:01.383378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff70aad-9e75-41bb-8398-5776e76d2ccd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:01.441640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff70aad-9e75-41bb-8398-5776e76d2ccd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:01.462439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ada9f-0d79-4db0-beaa-2a8747bf1046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:01.465732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada9f-0d79-4db0-beaa-2a8747bf1046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:01.466214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada9f-0d79-4db0-beaa-2a8747bf1046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:01.466680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ada9f-0d79-4db0-beaa-2a8747bf1046 admin admin] PATH_INFO: `/v3/projects/a4f840a9461c41adbfafae9b7a34cbe8/users/0331f78382b44fe8abdd94ca5bff3c87/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:01.472682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ada9f-0d79-4db0-beaa-2a8747bf1046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f840a9461c41adbfafae9b7a34cbe8, user_id=0331f78382b44fe8abdd94ca5bff3c87, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:01.481851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ada9f-0d79-4db0-beaa-2a8747bf1046 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:01.538259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 959/1939] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:01 2022] PUT /identity/v3/projects/a4f840a9461c41adbfafae9b7a34cbe8/users/0331f78382b44fe8abdd94ca5bff3c87/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:01.552597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff20e1-75e7-442c-9e6d-87a4c0ad6d0b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:01.552871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff20e1-75e7-442c-9e6d-87a4c0ad6d0b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:01.553254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff20e1-75e7-442c-9e6d-87a4c0ad6d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:01.598002 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7aff20e1-75e7-442c-9e6d-87a4c0ad6d0b None None] MFA Rules not processed for user `0331f78382b44fe8abdd94ca5bff3c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:01.600376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986d0cac4f924a4bbcf3e520d3d80090', 'request_id': 'req-f0159d7c-31ec-477e-a4b1-46e9d214392b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:01.600743 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7aff20e1-75e7-442c-9e6d-87a4c0ad6d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:01.654077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986d0cac4f924a4bbcf3e520d3d80090', 'request_id': 'req-f0159d7c-31ec-477e-a4b1-46e9d214392b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:01.680634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986d0cac4f924a4bbcf3e520d3d80090', 'request_id': 'req-f0159d7c-31ec-477e-a4b1-46e9d214392b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:01.741535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] The token cache is being invalidate because project 986d0cac4f924a4bbcf3e520d3d80090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:01.742410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:01.745808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:01.754240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 981/1940] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:01 2022] DELETE /identity/v3/projects/986d0cac4f924a4bbcf3e520d3d80090 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:01.759341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:01.778415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:01.814756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 960/1941] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:01.830995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff20e1-75e7-442c-9e6d-87a4c0ad6d0b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:01.833884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7aff20e1-75e7-442c-9e6d-87a4c0ad6d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:01.851972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:01.932858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159d7c-31ec-477e-a4b1-46e9d214392b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:02.038670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff20e1-75e7-442c-9e6d-87a4c0ad6d0b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:02.058272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:02.059262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:02.059755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:02.060203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:02.095656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:02.097024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:02.113813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:02.114317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:02.119268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:02.120018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:02.120544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] PATH_INFO: `/v3/users/398723ec4e8e43cb949d342208fba8bd` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:02.124916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=398723ec4e8e43cb949d342208fba8bd)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:02.129581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:02.153870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 961/1942] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:02.154951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:02.157595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:02.200771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751daaa-8f8f-4e22-b7de-cf9162fa4fd2 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:02.218012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:02.218837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:02.219184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:02.219383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] PATH_INFO: `/v3/projects/4f88928b864f422d96625acf2564f052` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:02.223136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f88928b864f422d96625acf2564f052)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:02.224427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:02.276141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398723ec4e8e43cb949d342208fba8bd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.297460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398723ec4e8e43cb949d342208fba8bd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.298441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398723ec4e8e43cb949d342208fba8bd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.299286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398723ec4e8e43cb949d342208fba8bd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.316491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398723ec4e8e43cb949d342208fba8bd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.360048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 982/1943] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:01 2022] DELETE /identity/v3/users/398723ec4e8e43cb949d342208fba8bd => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:02.370232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f88928b864f422d96625acf2564f052', 'request_id': 'req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.392493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f88928b864f422d96625acf2564f052', 'request_id': 'req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.427322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f88928b864f422d96625acf2564f052', 'request_id': 'req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.459188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] The token cache is being invalidate because project 4f88928b864f422d96625acf2564f052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:02.460219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.465173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.469255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 962/1944] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:02 2022] DELETE /identity/v3/projects/4f88928b864f422d96625acf2564f052 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:02.474608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:02.478019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:02.703334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:02.719009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d94174-36ee-431d-b6ef-82d0826a4bae admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:02.745499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:02.746508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:02.746898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:02.757623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] PATH_INFO: `/v3/users/93ea9456301b4ccea1d386a24209c3d5` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:02.757623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ea9456301b4ccea1d386a24209c3d5)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:02.757623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:02.924336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ea9456301b4ccea1d386a24209c3d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.967527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ea9456301b4ccea1d386a24209c3d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.971396 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ea9456301b4ccea1d386a24209c3d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.972481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ea9456301b4ccea1d386a24209c3d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:02.999807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ea9456301b4ccea1d386a24209c3d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:03.061023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 983/1945] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:02 2022] DELETE /identity/v3/users/93ea9456301b4ccea1d386a24209c3d5 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:03.321084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:03.323024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:03.543016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb76d-fbe7-41aa-a25d-cd36a035d883 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:03.676187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0331f78382b44fe8abdd94ca5bff3c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4f840a9461c41adbfafae9b7a34cbe8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:03.678695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:03.679246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:03.679746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:03.682407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:03.684282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:03.688658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:03.717893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 963/1946] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:45:03.722032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:03.724152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:03.744926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ab29-bf82-4dca-b174-b1339ca52b79 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:03.752813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587418a-dfef-4a12-9b78-a03b58f02b93 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0331f78382b44fe8abdd94ca5bff3c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4f840a9461c41adbfafae9b7a34cbe8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:03.756228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587418a-dfef-4a12-9b78-a03b58f02b93 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:03.757179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587418a-dfef-4a12-9b78-a03b58f02b93 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:03.757967 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587418a-dfef-4a12-9b78-a03b58f02b93 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:03.758964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587418a-dfef-4a12-9b78-a03b58f02b93 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:03.763599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587418a-dfef-4a12-9b78-a03b58f02b93 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:03.846128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:03.847054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 984/1947] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:03 2022] POST /identity/v3/projects => generated 355 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:03.852891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:03.853548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587418a-dfef-4a12-9b78-a03b58f02b93 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:03.971637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:04.030578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587418a-dfef-4a12-9b78-a03b58f02b93 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:04.040083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0331f78382b44fe8abdd94ca5bff3c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4f840a9461c41adbfafae9b7a34cbe8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:04.041337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.041830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.042310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.044655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:04.045232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:04.049534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:04.057667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951c04c-c0a5-4e78-be3a-1824ec5d9e1b tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:04.084507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 985/1948] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:04.086154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:04.088522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:04.170883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:04.183900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:04.184948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.185232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.185575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] PATH_INFO: `/v3/projects/5c12965694954a5b96c3e8e152186371` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.187699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c12965694954a5b96c3e8e152186371)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:04.190404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:04.194537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98aefa-7a95-4a07-a051-0d4644abcb67 tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:04.200608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:04.201447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.201729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.202034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] PATH_INFO: `/v3/projects/d7af68e282c24182be9a2bbcf235c8e9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.203411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7af68e282c24182be9a2bbcf235c8e9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:04.205507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:04.256482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c12965694954a5b96c3e8e152186371', 'request_id': 'req-ab3c73f3-3238-4aca-a568-d4847c626bf4'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.265525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7af68e282c24182be9a2bbcf235c8e9', 'request_id': 'req-72890818-3d08-41b4-82b3-3fd21d7cb00c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.265803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c12965694954a5b96c3e8e152186371', 'request_id': 'req-ab3c73f3-3238-4aca-a568-d4847c626bf4'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.274332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7af68e282c24182be9a2bbcf235c8e9', 'request_id': 'req-72890818-3d08-41b4-82b3-3fd21d7cb00c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.278801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c12965694954a5b96c3e8e152186371', 'request_id': 'req-ab3c73f3-3238-4aca-a568-d4847c626bf4'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.290849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7af68e282c24182be9a2bbcf235c8e9', 'request_id': 'req-72890818-3d08-41b4-82b3-3fd21d7cb00c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.300692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] The token cache is being invalidate because project 5c12965694954a5b96c3e8e152186371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:04.301334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.302610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.305877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 964/1949] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:03 2022] DELETE /identity/v3/projects/5c12965694954a5b96c3e8e152186371 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:04.307250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:04.308882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:04.313640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] The token cache is being invalidate because project d7af68e282c24182be9a2bbcf235c8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:04.314086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.315173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-72890818-3d08-41b4-82b3-3fd21d7cb00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.318993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 986/1950] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:04 2022] DELETE /identity/v3/projects/d7af68e282c24182be9a2bbcf235c8e9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:04.320553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb89623-b17f-44ca-9e64-af7f5e75d6f0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.320907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb89623-b17f-44ca-9e64-af7f5e75d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.321227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb89623-b17f-44ca-9e64-af7f5e75d6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.346334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5fb89623-b17f-44ca-9e64-af7f5e75d6f0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:04.347571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5fb89623-b17f-44ca-9e64-af7f5e75d6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:04.418262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c73f3-3238-4aca-a568-d4847c626bf4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:04.425660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:04.438189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 987/1951] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:04.440173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade287a-70c2-4de5-8450-5af1ee6ef0f5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.440465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade287a-70c2-4de5-8450-5af1ee6ef0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.440769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade287a-70c2-4de5-8450-5af1ee6ef0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.465188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4ade287a-70c2-4de5-8450-5af1ee6ef0f5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:04.466614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4ade287a-70c2-4de5-8450-5af1ee6ef0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:04.476704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 988/1952] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:04.478289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b875eb-ccff-4c94-b9dc-3bb8f570e534 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.478613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b875eb-ccff-4c94-b9dc-3bb8f570e534 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.478887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b875eb-ccff-4c94-b9dc-3bb8f570e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.513071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-07b875eb-ccff-4c94-b9dc-3bb8f570e534 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:04.515035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-07b875eb-ccff-4c94-b9dc-3bb8f570e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:04.525623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 989/1953] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:04.526897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d81b7-308a-4b8c-92de-e60200ee8cd9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.527244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d81b7-308a-4b8c-92de-e60200ee8cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.527578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d81b7-308a-4b8c-92de-e60200ee8cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.557652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-049d81b7-308a-4b8c-92de-e60200ee8cd9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:04.559381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-049d81b7-308a-4b8c-92de-e60200ee8cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:04.571048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 990/1954] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:04.572051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0331f78382b44fe8abdd94ca5bff3c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4f840a9461c41adbfafae9b7a34cbe8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:04.572547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d81b7-308a-4b8c-92de-e60200ee8cd9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:04.573146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.573653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.574127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] PATH_INFO: `/v3/projects/73f3a47fb78f4dd88aff19e191eb4aee` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.576371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73f3a47fb78f4dd88aff19e191eb4aee)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:04.580145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:04.587158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d81b7-308a-4b8c-92de-e60200ee8cd9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:04.592651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:04.593300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.593581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.593853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.594567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:04.594876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:04.596634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:04.611682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 991/1955] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:04.612481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:04.631858 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fe63-a8f1-41fc-b406-cef04aad3cea admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:04.641987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:04.644539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.644539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.644752 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.645933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:04.646547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:04.650046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:04.672534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f3a47fb78f4dd88aff19e191eb4aee', 'request_id': 'req-645c746b-22fe-4b1b-a01b-768e952b21bc'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.680860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 992/1956] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:04.682713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:04.687150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f3a47fb78f4dd88aff19e191eb4aee', 'request_id': 'req-645c746b-22fe-4b1b-a01b-768e952b21bc'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.703747 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470fd64-68fb-4346-a9ec-5f39e7bfd51a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:04.733255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f3a47fb78f4dd88aff19e191eb4aee', 'request_id': 'req-645c746b-22fe-4b1b-a01b-768e952b21bc'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.748779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:04.769141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] The token cache is being invalidate because project 73f3a47fb78f4dd88aff19e191eb4aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:04.769643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.771395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:04.781017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 965/1957] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:04 2022] DELETE /identity/v3/projects/73f3a47fb78f4dd88aff19e191eb4aee => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:04.782370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:04.785809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:04.841025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:04.842681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:04.843156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:04.843815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:04.845967 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:04.850813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:04.980849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c746b-22fe-4b1b-a01b-768e952b21bc tempest-VolumeQuotaClassesTest-703833688 tempest-VolumeQuotaClassesTest-703833688-project-admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.003246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 993/1958] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:04 2022] POST /identity/v3/projects => generated 393 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:05.003520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d9fa1-0e40-4d0e-8cbd-d3c3b9df5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.004691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d9fa1-0e40-4d0e-8cbd-d3c3b9df5119 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.004973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.008230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d9fa1-0e40-4d0e-8cbd-d3c3b9df5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.009925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:05.010867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d9fa1-0e40-4d0e-8cbd-d3c3b9df5119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.011639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d9fa1-0e40-4d0e-8cbd-d3c3b9df5119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.014003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d9fa1-0e40-4d0e-8cbd-d3c3b9df5119 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.106970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 966/1959] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:04 2022] POST /identity/v3/projects => generated 383 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:05.113838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d9fa1-0e40-4d0e-8cbd-d3c3b9df5119 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.205965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38413-279c-4a28-9f4b-1dc5130bccb6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.224825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:05.347483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d9fa1-0e40-4d0e-8cbd-d3c3b9df5119 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.373749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.374875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.375307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.375799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.376669 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.379425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.425230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 967/1960] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:05 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:05.426998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.431799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:05.446250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c0db-69e9-45ed-ac98-9d89d183207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.446971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c0db-69e9-45ed-ac98-9d89d183207c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.448889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c0db-69e9-45ed-ac98-9d89d183207c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.449172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c0db-69e9-45ed-ac98-9d89d183207c admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.450679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c0db-69e9-45ed-ac98-9d89d183207c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.453029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c0db-69e9-45ed-ac98-9d89d183207c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.454055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd4334-4440-4b7f-b80e-bb9bfc473bdb admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.464682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.465358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.465634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.465906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] PATH_INFO: `/v3/users/4d3a8fa510a7486eb101d8c20cf5909d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.467295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3a8fa510a7486eb101d8c20cf5909d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.469456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.489336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 994/1961] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:05 2022] POST /identity/v3/users => generated 297 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:05.490861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c0db-69e9-45ed-ac98-9d89d183207c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.513685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c0db-69e9-45ed-ac98-9d89d183207c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.527703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e543ff-8a04-4552-b51a-9c4979389a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.529286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e543ff-8a04-4552-b51a-9c4979389a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.529754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e543ff-8a04-4552-b51a-9c4979389a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.530168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e543ff-8a04-4552-b51a-9c4979389a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.530996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e543ff-8a04-4552-b51a-9c4979389a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.533070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e543ff-8a04-4552-b51a-9c4979389a9d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.574122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3a8fa510a7486eb101d8c20cf5909d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:05.579751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 995/1962] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:05.584401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e543ff-8a04-4552-b51a-9c4979389a9d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.594697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3a8fa510a7486eb101d8c20cf5909d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:05.605913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e543ff-8a04-4552-b51a-9c4979389a9d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.613392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.614281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.614742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.615172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.616150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.618580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.621058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3a8fa510a7486eb101d8c20cf5909d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:05.622200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3a8fa510a7486eb101d8c20cf5909d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:05.622956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3a8fa510a7486eb101d8c20cf5909d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:05.633687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 996/1963] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:05.635122 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.637562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:05.647514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 968/1964] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:05 2022] DELETE /identity/v3/users/4d3a8fa510a7486eb101d8c20cf5909d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:05.648652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.650519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:05.653279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156455a-1f56-4b35-87fc-fae66ac6e651 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.713453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:05.763385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d89ee9-4c7a-4ebd-bcf9-5fb5b2cbc816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.764458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d89ee9-4c7a-4ebd-bcf9-5fb5b2cbc816 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.765020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d89ee9-4c7a-4ebd-bcf9-5fb5b2cbc816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.765575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d89ee9-4c7a-4ebd-bcf9-5fb5b2cbc816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.766636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d89ee9-4c7a-4ebd-bcf9-5fb5b2cbc816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.769566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d89ee9-4c7a-4ebd-bcf9-5fb5b2cbc816 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.773549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09b83c-b7e3-47ea-a454-a1284f4fde78 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.784369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153b986-71b3-4f20-bf32-68b7e7eacdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.785432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b986-71b3-4f20-bf32-68b7e7eacdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.785899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b986-71b3-4f20-bf32-68b7e7eacdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.786476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b986-71b3-4f20-bf32-68b7e7eacdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.787861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153b986-71b3-4f20-bf32-68b7e7eacdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.790057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 997/1965] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:05.791369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153b986-71b3-4f20-bf32-68b7e7eacdf0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.792298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d554e0-1277-4c70-b7ac-1e7d19dc0c91 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.793346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d554e0-1277-4c70-b7ac-1e7d19dc0c91 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.793852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d554e0-1277-4c70-b7ac-1e7d19dc0c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.812097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 969/1966] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:05.813268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153b986-71b3-4f20-bf32-68b7e7eacdf0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.828001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-58d554e0-1277-4c70-b7ac-1e7d19dc0c91 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:05.830232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-58d554e0-1277-4c70-b7ac-1e7d19dc0c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:05.832918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153b986-71b3-4f20-bf32-68b7e7eacdf0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.839411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.840094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.840368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.840638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] PATH_INFO: `/v3/projects/0b2e9bc924b34efa9a5c1f03cc030eff/users/96d6f51abe0440c6ad8d508b4a128aa2/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.853478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 998/1967] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:05.855522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d554e0-1277-4c70-b7ac-1e7d19dc0c91 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.866664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2e9bc924b34efa9a5c1f03cc030eff, user_id=96d6f51abe0440c6ad8d508b4a128aa2, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.870636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.872989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d554e0-1277-4c70-b7ac-1e7d19dc0c91 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:05.877272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:05.883886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0f73f-89e1-4618-bd08-951da3598d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:05.884962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f73f-89e1-4618-bd08-951da3598d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.886139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f73f-89e1-4618-bd08-951da3598d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.886668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f73f-89e1-4618-bd08-951da3598d1f admin admin] PATH_INFO: `/v3/projects/740f25dd46e64bd1a90816c2e1417244/users/a587c056a80348b9bf3b553876719f05/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.896527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 970/1968] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:05 2022] PUT /identity/v3/projects/0b2e9bc924b34efa9a5c1f03cc030eff/users/96d6f51abe0440c6ad8d508b4a128aa2/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:05.897880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:05.900606 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:05.923789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0f73f-89e1-4618-bd08-951da3598d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=740f25dd46e64bd1a90816c2e1417244, user_id=a587c056a80348b9bf3b553876719f05, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:05.930203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0f73f-89e1-4618-bd08-951da3598d1f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:05.962457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 999/1969] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:05 2022] PUT /identity/v3/projects/740f25dd46e64bd1a90816c2e1417244/users/a587c056a80348b9bf3b553876719f05/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:05.962457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871cc8-3473-4dc0-983b-4b559494cc56 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:05.962457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871cc8-3473-4dc0-983b-4b559494cc56 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:05.962457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871cc8-3473-4dc0-983b-4b559494cc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:05.988493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62a34-2aa6-4895-b8f2-4c457156cce7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:06.027218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-19871cc8-3473-4dc0-983b-4b559494cc56 None None] MFA Rules not processed for user `96d6f51abe0440c6ad8d508b4a128aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:06.030616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-19871cc8-3473-4dc0-983b-4b559494cc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:06.058069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63903a1a-7bd1-4160-9d56-adf509d5f7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:06.058577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63903a1a-7bd1-4160-9d56-adf509d5f7be service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.058858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63903a1a-7bd1-4160-9d56-adf509d5f7be service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.059131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63903a1a-7bd1-4160-9d56-adf509d5f7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.157800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63903a1a-7bd1-4160-9d56-adf509d5f7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:06.159546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63903a1a-7bd1-4160-9d56-adf509d5f7be service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:06.172528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1000/1970] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:06.174856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa44f-3d3e-4baf-bbc8-f7e407a61666 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.175427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa44f-3d3e-4baf-bbc8-f7e407a61666 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.176009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa44f-3d3e-4baf-bbc8-f7e407a61666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.182933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 971/1971] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:06.186245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63903a1a-7bd1-4160-9d56-adf509d5f7be service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:06.206933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63903a1a-7bd1-4160-9d56-adf509d5f7be service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:06.218907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:06.220386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.220953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.222045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.224553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:06.229282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:06.260019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-90dfa44f-3d3e-4baf-bbc8-f7e407a61666 None None] MFA Rules not processed for user `a587c056a80348b9bf3b553876719f05`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:06.263014 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-90dfa44f-3d3e-4baf-bbc8-f7e407a61666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:06.326996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 972/1972] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:06 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:06.328759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:06.336679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:06.390694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:06.425893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761b954-03fd-43a7-964d-b21b970a6e92 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:06.432771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:06.433234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.433617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.433790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] PATH_INFO: `/v3/users/fdd90b1468c44fd1b0f5e5f9f7c31fe1` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.435064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd90b1468c44fd1b0f5e5f9f7c31fe1)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:06.437192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:06.441432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1001/1973] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:06.441432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfa44f-3d3e-4baf-bbc8-f7e407a61666 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:06.459084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfa44f-3d3e-4baf-bbc8-f7e407a61666 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:06.466188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4afde6-95a2-46cc-be3d-51606e3ed2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:06.467412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4afde6-95a2-46cc-be3d-51606e3ed2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.468634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4afde6-95a2-46cc-be3d-51606e3ed2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.469073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4afde6-95a2-46cc-be3d-51606e3ed2ff admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.469969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4afde6-95a2-46cc-be3d-51606e3ed2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:06.472449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4afde6-95a2-46cc-be3d-51606e3ed2ff admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:06.494839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:06.519456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1002/1974] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:06 2022] POST /identity/v3/users => generated 297 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:06.523265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4afde6-95a2-46cc-be3d-51606e3ed2ff admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:06.536561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4afde6-95a2-46cc-be3d-51606e3ed2ff admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:06.540332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd90b1468c44fd1b0f5e5f9f7c31fe1'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:06.544844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:06.545514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.545989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.546130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.546927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:06.549221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:06.571975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd90b1468c44fd1b0f5e5f9f7c31fe1'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:06.589747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd90b1468c44fd1b0f5e5f9f7c31fe1'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:06.591303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd90b1468c44fd1b0f5e5f9f7c31fe1'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:06.592474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd90b1468c44fd1b0f5e5f9f7c31fe1'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:06.604411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1003/1975] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:06 2022] POST /identity/v3/projects => generated 393 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:06.606214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:06.608823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:06.653901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 973/1976] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:06 2022] DELETE /identity/v3/users/fdd90b1468c44fd1b0f5e5f9f7c31fe1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:06.658603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:06.662612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:06.714884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd99661-0c0c-4604-af04-ac9bae36032b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:06.871474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c954-fc47-46d6-b832-f0dff6fcc20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:06.872296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c954-fc47-46d6-b832-f0dff6fcc20d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.872622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c954-fc47-46d6-b832-f0dff6fcc20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.873051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c954-fc47-46d6-b832-f0dff6fcc20d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.874118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0c954-fc47-46d6-b832-f0dff6fcc20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:06.878809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0c954-fc47-46d6-b832-f0dff6fcc20d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:06.920484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1004/1977] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:06.932966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0e9c-d097-4467-a1ca-dadbc3352f23 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.933352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0e9c-d097-4467-a1ca-dadbc3352f23 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.933829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0e9c-d097-4467-a1ca-dadbc3352f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.956932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a559258-6118-4319-bacc-1ec380d8de72 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:06.966581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef9fd6-47d1-4ee7-adc2-f6167674edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:06.967660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef9fd6-47d1-4ee7-adc2-f6167674edb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:06.968169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef9fd6-47d1-4ee7-adc2-f6167674edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:06.968635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef9fd6-47d1-4ee7-adc2-f6167674edb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:06.969827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef9fd6-47d1-4ee7-adc2-f6167674edb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:06.973930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef9fd6-47d1-4ee7-adc2-f6167674edb4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:06.999535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9c9c0e9c-d097-4467-a1ca-dadbc3352f23 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:07.001834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9c9c0e9c-d097-4467-a1ca-dadbc3352f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:07.079262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 974/1978] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:06 2022] POST /identity/v3/users => generated 303 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:07.080564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef9fd6-47d1-4ee7-adc2-f6167674edb4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.088273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1005/1979] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:07.093388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c0e9c-d097-4467-a1ca-dadbc3352f23 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.122996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef9fd6-47d1-4ee7-adc2-f6167674edb4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.130546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.131977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.131977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.133115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] PATH_INFO: `/v3/projects/5a2aef326833445393f285d0aad7fc1c/users/b4e86b137f014b34b1f094a355558ccd/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.133465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c0e9c-d097-4467-a1ca-dadbc3352f23 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.154033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.155236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.155734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.156224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.157413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.160177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2aef326833445393f285d0aad7fc1c, user_id=b4e86b137f014b34b1f094a355558ccd, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.162198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:07.171014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:07.193348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 975/1980] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:07 2022] PUT /identity/v3/projects/5a2aef326833445393f285d0aad7fc1c/users/b4e86b137f014b34b1f094a355558ccd/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:07.196106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.199908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:07.213455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1006/1981] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:07.214427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.220563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:07.237161 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b48e4-5e6d-46a5-b1f5-210c15caa2e3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.262070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:07.310868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909363bc-def9-463d-89fd-afda66d8bf4e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.319287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676170fa-c059-4815-9e91-2432c7628fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.320391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676170fa-c059-4815-9e91-2432c7628fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.320828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676170fa-c059-4815-9e91-2432c7628fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.321273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676170fa-c059-4815-9e91-2432c7628fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.338565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.339259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.339536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.339891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] PATH_INFO: `/v3/projects/3eb4746b9c96458cb1e9aff610f46085` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.342225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb4746b9c96458cb1e9aff610f46085)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.345375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:07.358625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:07.426100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb4746b9c96458cb1e9aff610f46085', 'request_id': 'req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.440301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676170fa-c059-4815-9e91-2432c7628fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.440920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb4746b9c96458cb1e9aff610f46085', 'request_id': 'req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.442621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676170fa-c059-4815-9e91-2432c7628fc1 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:07.447774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb4746b9c96458cb1e9aff610f46085', 'request_id': 'req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.460240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 976/1982] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:07.462158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676170fa-c059-4815-9e91-2432c7628fc1 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.471993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] The token cache is being invalidate because project 3eb4746b9c96458cb1e9aff610f46085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:07.472897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.474483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676170fa-c059-4815-9e91-2432c7628fc1 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.475727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.477995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1007/1983] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:07 2022] DELETE /identity/v3/projects/3eb4746b9c96458cb1e9aff610f46085 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:07.480669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.483288 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:07.619707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a4c3-b81e-48c4-9ee4-66a89f23cd9c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.626138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.627486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.627893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.628248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] PATH_INFO: `/v3/projects/1e277e336a8240e9a054789da3cf8f51/users/7b962ae9384548a4845b0c9f5cd111fb/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.638143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.640009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.640862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.641095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.642308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.646517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:07.648915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e277e336a8240e9a054789da3cf8f51, user_id=7b962ae9384548a4845b0c9f5cd111fb, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.652861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:07.672701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 977/1984] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:07.672701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.676150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:07.682817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1008/1985] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:07 2022] PUT /identity/v3/projects/1e277e336a8240e9a054789da3cf8f51/users/7b962ae9384548a4845b0c9f5cd111fb/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:07.682817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.684832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:07.717652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc4d73-dd32-4f01-81d7-7583e7246a37 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.817965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658addc-d1ce-4fcf-998a-1c069a2e66e0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.826362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9e017-4072-438a-a6cf-4ceeeb786c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.827274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9e017-4072-438a-a6cf-4ceeeb786c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.827653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9e017-4072-438a-a6cf-4ceeeb786c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.828012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9e017-4072-438a-a6cf-4ceeeb786c7b admin admin] PATH_INFO: `/v3/projects/5a2aef326833445393f285d0aad7fc1c/users/b4e86b137f014b34b1f094a355558ccd/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.830606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9e017-4072-438a-a6cf-4ceeeb786c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2aef326833445393f285d0aad7fc1c, user_id=b4e86b137f014b34b1f094a355558ccd, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.831530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.833236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.833580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.834156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] PATH_INFO: `/v3/users/0331f78382b44fe8abdd94ca5bff3c87` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.834314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9e017-4072-438a-a6cf-4ceeeb786c7b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:07.836064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0331f78382b44fe8abdd94ca5bff3c87)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.839985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:07.853421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1009/1986] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:07 2022] PUT /identity/v3/projects/5a2aef326833445393f285d0aad7fc1c/users/b4e86b137f014b34b1f094a355558ccd/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:07.854552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9e017-4072-438a-a6cf-4ceeeb786c7b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:07.872541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:07.876720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:07.952198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0331f78382b44fe8abdd94ca5bff3c87'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.974801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0331f78382b44fe8abdd94ca5bff3c87'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.981758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9e017-4072-438a-a6cf-4ceeeb786c7b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:07.987574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0331f78382b44fe8abdd94ca5bff3c87'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.987883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232d171-ce33-45f6-8040-9f0c17eed501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:07.988299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232d171-ce33-45f6-8040-9f0c17eed501 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:07.988576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232d171-ce33-45f6-8040-9f0c17eed501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:07.988888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232d171-ce33-45f6-8040-9f0c17eed501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:07.989617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232d171-ce33-45f6-8040-9f0c17eed501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:07.990129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0331f78382b44fe8abdd94ca5bff3c87'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.991438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0331f78382b44fe8abdd94ca5bff3c87'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:07.992002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232d171-ce33-45f6-8040-9f0c17eed501 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:08.009597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1010/1987] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:08.009597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5844e5e-5451-4d46-8358-d93cb16b8407 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:08.009597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5844e5e-5451-4d46-8358-d93cb16b8407 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:08.009597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5844e5e-5451-4d46-8358-d93cb16b8407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:08.022201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 978/1988] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:07 2022] DELETE /identity/v3/users/0331f78382b44fe8abdd94ca5bff3c87 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:08.024051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:08.026811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.057520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c5844e5e-5451-4d46-8358-d93cb16b8407 None None] MFA Rules not processed for user `b4e86b137f014b34b1f094a355558ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:08.059207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c5844e5e-5451-4d46-8358-d93cb16b8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.202750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302ef18-42c0-4faf-a847-1d2394b0ad87 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:08.220398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:08.221727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:08.224927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:08.225546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] PATH_INFO: `/v3/projects/0b849db863cc46eb97302d7d32edca7c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:08.229207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b849db863cc46eb97302d7d32edca7c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:08.234791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:08.320598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1011/1989] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:08.320598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5844e5e-5451-4d46-8358-d93cb16b8407 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:08.331970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b849db863cc46eb97302d7d32edca7c', 'request_id': 'req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.333762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c5844e5e-5451-4d46-8358-d93cb16b8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.348707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b849db863cc46eb97302d7d32edca7c', 'request_id': 'req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.368085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b849db863cc46eb97302d7d32edca7c', 'request_id': 'req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.379600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5844e5e-5451-4d46-8358-d93cb16b8407 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:08.399757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] The token cache is being invalidate because project 0b849db863cc46eb97302d7d32edca7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:08.400836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.403501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.424793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 979/1990] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:08 2022] DELETE /identity/v3/projects/0b849db863cc46eb97302d7d32edca7c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:08.427816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:08.431586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.487754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:08.589327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd890f-8e97-466a-be9e-42e8e7dd2fc5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:08.594413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:08.595379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:08.595856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:08.595994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79a449-904b-493f-87e3-492f31750035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:08.596399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] PATH_INFO: `/v3/projects/1e277e336a8240e9a054789da3cf8f51/users/7b962ae9384548a4845b0c9f5cd111fb/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:08.597004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a449-904b-493f-87e3-492f31750035 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:08.597683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a449-904b-493f-87e3-492f31750035 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:08.597916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a449-904b-493f-87e3-492f31750035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:08.600220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e277e336a8240e9a054789da3cf8f51, user_id=7b962ae9384548a4845b0c9f5cd111fb, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:08.602980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8a79a449-904b-493f-87e3-492f31750035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.605180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:08.623766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1012/1991] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:08 2022] PUT /identity/v3/projects/1e277e336a8240e9a054789da3cf8f51/users/7b962ae9384548a4845b0c9f5cd111fb/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:08.625145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:08.627868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.678480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:08.723937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79a449-904b-493f-87e3-492f31750035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:08.725973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79a449-904b-493f-87e3-492f31750035 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:08.737323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 980/1992] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:08.738781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea96d1-ac27-4079-aa24-6b0a03fd4fce None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:08.739067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea96d1-ac27-4079-aa24-6b0a03fd4fce None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:08.739367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea96d1-ac27-4079-aa24-6b0a03fd4fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:08.744282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666213c7-ebb4-4d56-967b-051f7f062868 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:08.749659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:08.750344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:08.750652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:08.750924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] PATH_INFO: `/v3/users/7fb21ec24bd044db93b05aeed19c45cc` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:08.752264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb21ec24bd044db93b05aeed19c45cc)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:08.754341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:08.775088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-43ea96d1-ac27-4079-aa24-6b0a03fd4fce None None] MFA Rules not processed for user `7b962ae9384548a4845b0c9f5cd111fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:08.776389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-43ea96d1-ac27-4079-aa24-6b0a03fd4fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.822267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb21ec24bd044db93b05aeed19c45cc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.839082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb21ec24bd044db93b05aeed19c45cc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.839999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb21ec24bd044db93b05aeed19c45cc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.840655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb21ec24bd044db93b05aeed19c45cc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.850847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb21ec24bd044db93b05aeed19c45cc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:08.869401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1013/1993] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:08 2022] DELETE /identity/v3/users/7fb21ec24bd044db93b05aeed19c45cc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:08.870877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:08.872705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.908070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 981/1994] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:08.910666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea96d1-ac27-4079-aa24-6b0a03fd4fce None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:08.915627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-43ea96d1-ac27-4079-aa24-6b0a03fd4fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:08.996603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3ae09-7e47-4993-9a35-2a442f6caf1e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:09.005086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:09.006078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.006729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.007296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] PATH_INFO: `/v3/projects/a4f840a9461c41adbfafae9b7a34cbe8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.009585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4f840a9461c41adbfafae9b7a34cbe8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:09.013205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:09.014737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea96d1-ac27-4079-aa24-6b0a03fd4fce None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:09.029073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:09.106162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:09.106303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fb074-f25e-4ec4-a669-9dcf02430c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:09.107131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb074-f25e-4ec4-a669-9dcf02430c42 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.107796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb074-f25e-4ec4-a669-9dcf02430c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.108279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb074-f25e-4ec4-a669-9dcf02430c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.111661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e66fb074-f25e-4ec4-a669-9dcf02430c42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.115154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f840a9461c41adbfafae9b7a34cbe8', 'request_id': 'req-a6c9ff7f-9f0b-4565-8580-f74995df52f2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.132882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f840a9461c41adbfafae9b7a34cbe8', 'request_id': 'req-a6c9ff7f-9f0b-4565-8580-f74995df52f2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.142400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f840a9461c41adbfafae9b7a34cbe8', 'request_id': 'req-a6c9ff7f-9f0b-4565-8580-f74995df52f2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.164949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] The token cache is being invalidate because project a4f840a9461c41adbfafae9b7a34cbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:09.165617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.166593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.168595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1014/1995] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:08 2022] DELETE /identity/v3/projects/a4f840a9461c41adbfafae9b7a34cbe8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:09.169895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:09.171437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.230812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fb074-f25e-4ec4-a669-9dcf02430c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:09.232261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fb074-f25e-4ec4-a669-9dcf02430c42 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:09.244005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 982/1996] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:09.245208 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce47bd-89b2-459d-a894-3666411cdaf5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.245493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce47bd-89b2-459d-a894-3666411cdaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.245774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce47bd-89b2-459d-a894-3666411cdaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.271062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c4ce47bd-89b2-459d-a894-3666411cdaf5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:09.272758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c4ce47bd-89b2-459d-a894-3666411cdaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.290443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9ff7f-9f0b-4565-8580-f74995df52f2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:09.324505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:09.325426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.325596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.327457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.332406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.378432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 983/1997] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:09.380437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e72b3-3b5d-492f-a958-c3d6e39a66fe None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.380865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e72b3-3b5d-492f-a958-c3d6e39a66fe None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.381310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e72b3-3b5d-492f-a958-c3d6e39a66fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.413807 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8c7e72b3-3b5d-492f-a958-c3d6e39a66fe None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:09.416014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8c7e72b3-3b5d-492f-a958-c3d6e39a66fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.431809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 984/1998] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:09.432776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e72b3-3b5d-492f-a958-c3d6e39a66fe None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:09.434258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8c7e72b3-3b5d-492f-a958-c3d6e39a66fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.448806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e72b3-3b5d-492f-a958-c3d6e39a66fe None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:09.454844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:09.455512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.455867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.456120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] PATH_INFO: `/v3/projects/2dae4db77d324878872a6e4c0a601651` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.457542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dae4db77d324878872a6e4c0a601651)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:09.459712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:09.504164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:09.506849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:09.526203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1015/1999] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:09 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:09.527826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:09.545560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dae4db77d324878872a6e4c0a601651', 'request_id': 'req-cacfab5a-ac7e-4e4e-9a73-0a4008243824'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.557480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895238c-1edd-4bc1-bbd7-85b6256a44ae service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:09.559775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dae4db77d324878872a6e4c0a601651', 'request_id': 'req-cacfab5a-ac7e-4e4e-9a73-0a4008243824'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.562966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:09.595181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dae4db77d324878872a6e4c0a601651', 'request_id': 'req-cacfab5a-ac7e-4e4e-9a73-0a4008243824'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.640655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] The token cache is being invalidate because project 2dae4db77d324878872a6e4c0a601651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:09.641148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.642348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:09.650635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 985/2000] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:09 2022] DELETE /identity/v3/projects/2dae4db77d324878872a6e4c0a601651 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:09.651469 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:09.654449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.706289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ef21c-7f07-4f48-80f5-6450ae9402fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:09.707451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ef21c-7f07-4f48-80f5-6450ae9402fc admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.708278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ef21c-7f07-4f48-80f5-6450ae9402fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.708757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ef21c-7f07-4f48-80f5-6450ae9402fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.709921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ef21c-7f07-4f48-80f5-6450ae9402fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:09.710440 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ef21c-7f07-4f48-80f5-6450ae9402fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:09.713558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ef21c-7f07-4f48-80f5-6450ae9402fc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:09.761397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1016/2001] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:09.766035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cea6b-eaad-497c-911c-28aef085d1f9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.766713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cea6b-eaad-497c-911c-28aef085d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.767259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cea6b-eaad-497c-911c-28aef085d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.804009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-cb2cea6b-eaad-497c-911c-28aef085d1f9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:09.806862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cb2cea6b-eaad-497c-911c-28aef085d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.822773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfab5a-ac7e-4e4e-9a73-0a4008243824 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:09.828712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:09.829754 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.830204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.830770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.831631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1017/2002] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:09.833168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.833301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cea6b-eaad-497c-911c-28aef085d1f9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:09.835612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cb2cea6b-eaad-497c-911c-28aef085d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:09.863790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cea6b-eaad-497c-911c-28aef085d1f9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:09.873641 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7d7a3-e127-48b9-ab9d-24e27c5ecfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:09.874835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d7a3-e127-48b9-ab9d-24e27c5ecfec admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.875453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d7a3-e127-48b9-ab9d-24e27c5ecfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.875992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d7a3-e127-48b9-ab9d-24e27c5ecfec admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:09.877426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7d7a3-e127-48b9-ab9d-24e27c5ecfec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:09.881938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7d7a3-e127-48b9-ab9d-24e27c5ecfec admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:09.902610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:09.957252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1018/2003] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:09 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:09.957252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35f790-9956-4fd8-b6a7-40c78b210754 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:09.957252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35f790-9956-4fd8-b6a7-40c78b210754 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:09.957252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35f790-9956-4fd8-b6a7-40c78b210754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.001749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.003424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.005681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8b35f790-9956-4fd8-b6a7-40c78b210754 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:10.008195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8b35f790-9956-4fd8-b6a7-40c78b210754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:10.017547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 986/2004] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:10.018512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.034488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd912-7c5c-4576-b70a-561cf2fb1eed service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.151602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1019/2005] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:10.156928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35f790-9956-4fd8-b6a7-40c78b210754 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.172519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35f790-9956-4fd8-b6a7-40c78b210754 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.182632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.184718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.185268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.185712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.186901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:10.187823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.191147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.193440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bd412-16c2-4d59-b597-c5f6b689371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.194541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd412-16c2-4d59-b597-c5f6b689371c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.195269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd412-16c2-4d59-b597-c5f6b689371c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.195577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bd412-16c2-4d59-b597-c5f6b689371c admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.196562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bd412-16c2-4d59-b597-c5f6b689371c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.199752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bd412-16c2-4d59-b597-c5f6b689371c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.218192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1020/2006] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:10.222842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.236572 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 987/2007] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:10 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:10.242022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ff874-1450-42a9-8075-df4f21bacd57 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.243240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bd412-16c2-4d59-b597-c5f6b689371c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.257400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bd412-16c2-4d59-b597-c5f6b689371c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.258797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5415d-3123-4c61-a3f8-be6f6444810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.259721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5415d-3123-4c61-a3f8-be6f6444810c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.260198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5415d-3123-4c61-a3f8-be6f6444810c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.260693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5415d-3123-4c61-a3f8-be6f6444810c admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.261559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5415d-3123-4c61-a3f8-be6f6444810c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.263748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d950bff-7be5-4504-92d0-6a272e2976ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.264204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5415d-3123-4c61-a3f8-be6f6444810c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.264661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d950bff-7be5-4504-92d0-6a272e2976ff admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.265470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d950bff-7be5-4504-92d0-6a272e2976ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.266274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d950bff-7be5-4504-92d0-6a272e2976ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.267136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d950bff-7be5-4504-92d0-6a272e2976ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.271078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d950bff-7be5-4504-92d0-6a272e2976ff admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.286015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 988/2008] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:45:10.292123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d950bff-7be5-4504-92d0-6a272e2976ff admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.306475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d950bff-7be5-4504-92d0-6a272e2976ff admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.317959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.319217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.319724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.320237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.321976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.325229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.326114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1021/2009] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:10 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:10.331488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5415d-3123-4c61-a3f8-be6f6444810c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.364547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 989/2010] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:10.364547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.364547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:10.376967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:10.385338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b33b-1891-4cea-a0d7-52517e871ab7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.531801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.532570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5415d-3123-4c61-a3f8-be6f6444810c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.532776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.533158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.533632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] PATH_INFO: `/v3/users/96d6f51abe0440c6ad8d508b4a128aa2` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.536049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d6f51abe0440c6ad8d508b4a128aa2)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.540745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.548750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce51175-1efb-44fc-abd6-08e8aba08f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.549763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51175-1efb-44fc-abd6-08e8aba08f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.550152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51175-1efb-44fc-abd6-08e8aba08f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.550569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce51175-1efb-44fc-abd6-08e8aba08f1a admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.551355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce51175-1efb-44fc-abd6-08e8aba08f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.554421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce51175-1efb-44fc-abd6-08e8aba08f1a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.585716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1022/2011] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:10 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:10.586642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce51175-1efb-44fc-abd6-08e8aba08f1a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.603257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce51175-1efb-44fc-abd6-08e8aba08f1a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.612869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab4962-9b0a-4c76-b8ae-dfe81dccab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.614734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4962-9b0a-4c76-b8ae-dfe81dccab70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.615579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4962-9b0a-4c76-b8ae-dfe81dccab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.616196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4962-9b0a-4c76-b8ae-dfe81dccab70 admin admin] PATH_INFO: `/v3/projects/37d2e742c2c948ffa022cc4446b5e257/users/f8cf2e1faf1942df8f0bcbeccd34b0ba/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.641859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab4962-9b0a-4c76-b8ae-dfe81dccab70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d2e742c2c948ffa022cc4446b5e257, user_id=f8cf2e1faf1942df8f0bcbeccd34b0ba, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.643549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d6f51abe0440c6ad8d508b4a128aa2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:10.647716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab4962-9b0a-4c76-b8ae-dfe81dccab70 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.662031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d6f51abe0440c6ad8d508b4a128aa2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:10.671757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1023/2012] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:10 2022] PUT /identity/v3/projects/37d2e742c2c948ffa022cc4446b5e257/users/f8cf2e1faf1942df8f0bcbeccd34b0ba/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:10.673484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab4962-9b0a-4c76-b8ae-dfe81dccab70 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.675599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d6f51abe0440c6ad8d508b4a128aa2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:10.676636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d6f51abe0440c6ad8d508b4a128aa2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:10.677649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-323d95cd-3d2a-4f70-bae5-0c88570a25d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d6f51abe0440c6ad8d508b4a128aa2'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:10.695924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 990/2013] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:10 2022] DELETE /identity/v3/users/96d6f51abe0440c6ad8d508b4a128aa2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:10.700424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5aee2-d97f-4ec5-ac1c-728531973362 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.700999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5aee2-d97f-4ec5-ac1c-728531973362 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.701408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5aee2-d97f-4ec5-ac1c-728531973362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.714930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:10.738437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6af5aee2-d97f-4ec5-ac1c-728531973362 None None] MFA Rules not processed for user `f8cf2e1faf1942df8f0bcbeccd34b0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:10.741088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6af5aee2-d97f-4ec5-ac1c-728531973362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:10.762661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab4962-9b0a-4c76-b8ae-dfe81dccab70 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.847544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 991/2014] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:10.847873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.848527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.848682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019c12e-ba9e-426c-b456-83594ccc997a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.848976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019c12e-ba9e-426c-b456-83594ccc997a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.849114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.849324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019c12e-ba9e-426c-b456-83594ccc997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.849482 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.850679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.853807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.874818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1024/2015] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:10.874818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.874818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:10.880121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a019c12e-ba9e-426c-b456-83594ccc997a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:10.881674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a019c12e-ba9e-426c-b456-83594ccc997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:10.889149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bc8c3-d505-47be-9d00-018bb7c85286 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.890666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 992/2016] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:10.891179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019c12e-ba9e-426c-b456-83594ccc997a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.892583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a019c12e-ba9e-426c-b456-83594ccc997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:10.899561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b206a-2333-4a85-8bc7-ac53df837c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.900208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b206a-2333-4a85-8bc7-ac53df837c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.900591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b206a-2333-4a85-8bc7-ac53df837c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.901111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b206a-2333-4a85-8bc7-ac53df837c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.901792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b206a-2333-4a85-8bc7-ac53df837c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.904119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b206a-2333-4a85-8bc7-ac53df837c67 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.906736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019c12e-ba9e-426c-b456-83594ccc997a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:10.913567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:10.914329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:10.914631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:10.914908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:10.915587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:10.917277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:10.919987 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:10.935713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 993/2017] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:10.937917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:10.941512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:10.952092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1025/2018] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:10 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:10.953392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b206a-2333-4a85-8bc7-ac53df837c67 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.055895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dfb59-41bb-4c49-863f-327a6729f8ae admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.071364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b206a-2333-4a85-8bc7-ac53df837c67 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.079887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9391-ffc4-44d5-9890-2038f5fbe057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.081018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9391-ffc4-44d5-9890-2038f5fbe057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.081504 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9391-ffc4-44d5-9890-2038f5fbe057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.081988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9391-ffc4-44d5-9890-2038f5fbe057 admin admin] PATH_INFO: `/v3/projects/937a0e44a54a4ae6ac86a0e0477b8ccc/users/de7ac457b1774df9aa97ec565dab0762/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.109306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a9391-ffc4-44d5-9890-2038f5fbe057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937a0e44a54a4ae6ac86a0e0477b8ccc, user_id=de7ac457b1774df9aa97ec565dab0762, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.113224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a9391-ffc4-44d5-9890-2038f5fbe057 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.136872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1026/2019] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:10 2022] PUT /identity/v3/projects/937a0e44a54a4ae6ac86a0e0477b8ccc/users/de7ac457b1774df9aa97ec565dab0762/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:11.138287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9391-ffc4-44d5-9890-2038f5fbe057 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.160855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803017cf-32c0-4b55-a792-062d510ca45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.161918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803017cf-32c0-4b55-a792-062d510ca45b service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.162277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803017cf-32c0-4b55-a792-062d510ca45b service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.162824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803017cf-32c0-4b55-a792-062d510ca45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.179129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803017cf-32c0-4b55-a792-062d510ca45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.183602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803017cf-32c0-4b55-a792-062d510ca45b service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.200467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:11.202864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 994/2020] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:11.205580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf5a4-e1d3-495f-86dd-d2f762fb6da4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.206010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf5a4-e1d3-495f-86dd-d2f762fb6da4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.206571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf5a4-e1d3-495f-86dd-d2f762fb6da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.248514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a6dcf5a4-e1d3-495f-86dd-d2f762fb6da4 None None] MFA Rules not processed for user `de7ac457b1774df9aa97ec565dab0762`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:11.250729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a6dcf5a4-e1d3-495f-86dd-d2f762fb6da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:11.256212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9391-ffc4-44d5-9890-2038f5fbe057 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.262782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e807-e961-4742-830a-5468bcc97dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.263406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e807-e961-4742-830a-5468bcc97dde admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.264308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e807-e961-4742-830a-5468bcc97dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.264308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e807-e961-4742-830a-5468bcc97dde admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.264605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2e807-e961-4742-830a-5468bcc97dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.266582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2e807-e961-4742-830a-5468bcc97dde admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.307802 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1027/2021] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:11 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:11.312341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e807-e961-4742-830a-5468bcc97dde admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.326677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e807-e961-4742-830a-5468bcc97dde admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.332101 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa2c-975d-4771-86ca-ee871a2f16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.332729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa2c-975d-4771-86ca-ee871a2f16e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.333001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa2c-975d-4771-86ca-ee871a2f16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.333305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa2c-975d-4771-86ca-ee871a2f16e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.333903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703aa2c-975d-4771-86ca-ee871a2f16e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.336086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703aa2c-975d-4771-86ca-ee871a2f16e1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.364388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1028/2022] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:11.368840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa2c-975d-4771-86ca-ee871a2f16e1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.379715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703aa2c-975d-4771-86ca-ee871a2f16e1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.386693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 995/2023] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:11.386957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa6922-7088-4eb9-81cc-116684df7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.386957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6922-7088-4eb9-81cc-116684df7d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.386957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6922-7088-4eb9-81cc-116684df7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.386957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6922-7088-4eb9-81cc-116684df7d18 admin admin] PATH_INFO: `/v3/projects/3f06e658a73c4d8aabf5193a52c46a1c/users/a0c1183f33934328a1ac20b1f540b1b7/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.390160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf5a4-e1d3-495f-86dd-d2f762fb6da4 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.425143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf5a4-e1d3-495f-86dd-d2f762fb6da4 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.432909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa6922-7088-4eb9-81cc-116684df7d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f06e658a73c4d8aabf5193a52c46a1c, user_id=a0c1183f33934328a1ac20b1f540b1b7, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.435761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a1fde-324b-40da-b2de-1bb22f2895f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.436843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1fde-324b-40da-b2de-1bb22f2895f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.437313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1fde-324b-40da-b2de-1bb22f2895f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.437775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a1fde-324b-40da-b2de-1bb22f2895f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.440058 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a1fde-324b-40da-b2de-1bb22f2895f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.441356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa6922-7088-4eb9-81cc-116684df7d18 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.443601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a1fde-324b-40da-b2de-1bb22f2895f1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.477709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1029/2024] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:11 2022] PUT /identity/v3/projects/3f06e658a73c4d8aabf5193a52c46a1c/users/a0c1183f33934328a1ac20b1f540b1b7/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:11.490355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa6922-7088-4eb9-81cc-116684df7d18 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.513656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 996/2025] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:11 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:11.519009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a1fde-324b-40da-b2de-1bb22f2895f1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.552135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:11.634112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a1fde-324b-40da-b2de-1bb22f2895f1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.643407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442951-5ddc-445b-9f98-507e494792f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.645037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442951-5ddc-445b-9f98-507e494792f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.645672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442951-5ddc-445b-9f98-507e494792f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.645976 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442951-5ddc-445b-9f98-507e494792f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.647554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe442951-5ddc-445b-9f98-507e494792f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.652873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe442951-5ddc-445b-9f98-507e494792f8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.673487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa6922-7088-4eb9-81cc-116684df7d18 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.687020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facd6ec-d16f-455c-9899-36481ec3ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.687913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facd6ec-d16f-455c-9899-36481ec3ceb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.688349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facd6ec-d16f-455c-9899-36481ec3ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.688805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facd6ec-d16f-455c-9899-36481ec3ceb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.689752 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facd6ec-d16f-455c-9899-36481ec3ceb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.693021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facd6ec-d16f-455c-9899-36481ec3ceb7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.716934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1030/2026] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:11.723649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facd6ec-d16f-455c-9899-36481ec3ceb7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.735485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 997/2027] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:11 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:11.739562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442951-5ddc-445b-9f98-507e494792f8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.758934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facd6ec-d16f-455c-9899-36481ec3ceb7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.767443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442951-5ddc-445b-9f98-507e494792f8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.775024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d65f81-a9e1-48cb-b0c6-ec963f6f7eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.775712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65f81-a9e1-48cb-b0c6-ec963f6f7eba admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.776031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65f81-a9e1-48cb-b0c6-ec963f6f7eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.776389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d65f81-a9e1-48cb-b0c6-ec963f6f7eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.777198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d65f81-a9e1-48cb-b0c6-ec963f6f7eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.779306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d65f81-a9e1-48cb-b0c6-ec963f6f7eba admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.780963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.782153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.782575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.783063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] PATH_INFO: `/v3/projects/3f06e658a73c4d8aabf5193a52c46a1c/users/a0c1183f33934328a1ac20b1f540b1b7/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.787691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f06e658a73c4d8aabf5193a52c46a1c, user_id=a0c1183f33934328a1ac20b1f540b1b7, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.795883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.805445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 998/2028] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:11.812536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d65f81-a9e1-48cb-b0c6-ec963f6f7eba admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.827163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1031/2029] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:11 2022] PUT /identity/v3/projects/3f06e658a73c4d8aabf5193a52c46a1c/users/a0c1183f33934328a1ac20b1f540b1b7/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:11.828656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:11.831642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:11.839092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d65f81-a9e1-48cb-b0c6-ec963f6f7eba admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:11.957175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5dc5e-572e-4e5c-8a07-e6a9c0e23daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:11.958844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5dc5e-572e-4e5c-8a07-e6a9c0e23daa admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:11.959141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5dc5e-572e-4e5c-8a07-e6a9c0e23daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:11.960667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5dc5e-572e-4e5c-8a07-e6a9c0e23daa admin admin] PATH_INFO: `/v3/projects/4fb725dd6fa94262b51b277e11491013/users/acdc97c05006416b938dd741e50838a9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:11.993608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5dc5e-572e-4e5c-8a07-e6a9c0e23daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb725dd6fa94262b51b277e11491013, user_id=acdc97c05006416b938dd741e50838a9, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:11.997246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5dc5e-572e-4e5c-8a07-e6a9c0e23daa admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:11.999716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f611d7-4a49-477a-a978-d8beaf16ab78 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:12.010155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:12.012136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:12.012789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:12.013708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] PATH_INFO: `/v3/projects/0b2e9bc924b34efa9a5c1f03cc030eff` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:12.016231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2e9bc924b34efa9a5c1f03cc030eff)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:12.017500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 999/2030] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:11 2022] PUT /identity/v3/projects/4fb725dd6fa94262b51b277e11491013/users/acdc97c05006416b938dd741e50838a9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:12.018960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc85193-95b0-4f23-a9bb-1ee00ad32e67 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:12.019205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc85193-95b0-4f23-a9bb-1ee00ad32e67 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:12.019479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc85193-95b0-4f23-a9bb-1ee00ad32e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:12.020650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:12.025186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:12.087947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-abc85193-95b0-4f23-a9bb-1ee00ad32e67 None None] MFA Rules not processed for user `a0c1183f33934328a1ac20b1f540b1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:12.091362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-abc85193-95b0-4f23-a9bb-1ee00ad32e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:12.142308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2e9bc924b34efa9a5c1f03cc030eff', 'request_id': 'req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.152326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2e9bc924b34efa9a5c1f03cc030eff', 'request_id': 'req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.161993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2e9bc924b34efa9a5c1f03cc030eff', 'request_id': 'req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.186343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] The token cache is being invalidate because project 0b2e9bc924b34efa9a5c1f03cc030eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:12.186822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.187550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.189726 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1032/2031] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:11 2022] DELETE /identity/v3/projects/0b2e9bc924b34efa9a5c1f03cc030eff => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:12.190646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:12.192866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:12.252822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1000/2032] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:12.254333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc85193-95b0-4f23-a9bb-1ee00ad32e67 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:12.258283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-abc85193-95b0-4f23-a9bb-1ee00ad32e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:12.280047 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:12.284306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6fe9c-a52f-4baa-9024-a4c39cc2dc4e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:12.293226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:12.294056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:12.294424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:12.295475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:12.295607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:12.297610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:12.316655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1033/2033] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:12.317773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:12.321063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:12.478189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc85193-95b0-4f23-a9bb-1ee00ad32e67 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:12.496496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:12.499248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:12.499687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:12.500113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] PATH_INFO: `/v3/users/b4e86b137f014b34b1f094a355558ccd` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:12.504463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e86b137f014b34b1f094a355558ccd)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:12.510128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4dc8-38f0-4685-824c-3165aa5f142f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:12.514056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:12.552299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdf5f0-1b86-4880-bd67-1c4505924c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:12.553510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf5f0-1b86-4880-bd67-1c4505924c24 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:12.554000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf5f0-1b86-4880-bd67-1c4505924c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:12.554518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf5f0-1b86-4880-bd67-1c4505924c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:12.653287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:12.660101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e86b137f014b34b1f094a355558ccd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.681987 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e86b137f014b34b1f094a355558ccd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.690229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e86b137f014b34b1f094a355558ccd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.691109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e86b137f014b34b1f094a355558ccd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.691765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e86b137f014b34b1f094a355558ccd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:12.710135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdf5f0-1b86-4880-bd67-1c4505924c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:12.715001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdf5f0-1b86-4880-bd67-1c4505924c24 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:12.715672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1001/2034] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:12 2022] DELETE /identity/v3/users/b4e86b137f014b34b1f094a355558ccd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:12.716758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:12.718954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:12.746250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1034/2035] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:12.859254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdf5f0-1b86-4880-bd67-1c4505924c24 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:12.871368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdf5f0-1b86-4880-bd67-1c4505924c24 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:12.916109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089ffc-d119-47f5-9864-121a6303e555 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:12.928544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560c246-69d2-438a-9a05-0f89cc840db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:12.930886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560c246-69d2-438a-9a05-0f89cc840db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:12.931853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560c246-69d2-438a-9a05-0f89cc840db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:12.932381 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560c246-69d2-438a-9a05-0f89cc840db5 admin admin] PATH_INFO: `/v3/projects/4fb725dd6fa94262b51b277e11491013/users/acdc97c05006416b938dd741e50838a9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:12.936174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560c246-69d2-438a-9a05-0f89cc840db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb725dd6fa94262b51b277e11491013, user_id=acdc97c05006416b938dd741e50838a9, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:12.941274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560c246-69d2-438a-9a05-0f89cc840db5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:12.957657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1002/2036] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:12 2022] PUT /identity/v3/projects/4fb725dd6fa94262b51b277e11491013/users/acdc97c05006416b938dd741e50838a9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:12.975088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f2ed-4cf2-4096-84f4-8d98d75921d0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:12.976090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f2ed-4cf2-4096-84f4-8d98d75921d0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:12.976640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f2ed-4cf2-4096-84f4-8d98d75921d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:12.993839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:12.994964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:12.995415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:12.995860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:12.999178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:13.037057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b461f2ed-4cf2-4096-84f4-8d98d75921d0 None None] MFA Rules not processed for user `acdc97c05006416b938dd741e50838a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:13.039051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b461f2ed-4cf2-4096-84f4-8d98d75921d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:13.051334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:13.173146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:13.174824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:13.188682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1003/2037] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:13.198747 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1035/2038] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:13.307596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f2ed-4cf2-4096-84f4-8d98d75921d0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:13.309378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b461f2ed-4cf2-4096-84f4-8d98d75921d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:13.409139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:13.410741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:13.431799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f2ed-4cf2-4096-84f4-8d98d75921d0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:13.437371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a3f5-f1bd-4c68-8ff4-f29767ffdcfd service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:13.441981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474044e0-58c1-412a-87d1-2837e8e53509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:13.445237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474044e0-58c1-412a-87d1-2837e8e53509 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:13.445613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474044e0-58c1-412a-87d1-2837e8e53509 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:13.445891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474044e0-58c1-412a-87d1-2837e8e53509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:13.467427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474044e0-58c1-412a-87d1-2837e8e53509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:13.469041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474044e0-58c1-412a-87d1-2837e8e53509 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:13.491835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1004/2039] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:45:13.567937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:13.568820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:13.569393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:13.569585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] PATH_INFO: `/v3/projects/5a2aef326833445393f285d0aad7fc1c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:13.571344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2aef326833445393f285d0aad7fc1c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:13.574001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:13.653381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:13.699536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2aef326833445393f285d0aad7fc1c', 'request_id': 'req-9e1389d3-5207-4c1b-ae67-70ed293417d1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:13.722022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2aef326833445393f285d0aad7fc1c', 'request_id': 'req-9e1389d3-5207-4c1b-ae67-70ed293417d1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:13.744647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2aef326833445393f285d0aad7fc1c', 'request_id': 'req-9e1389d3-5207-4c1b-ae67-70ed293417d1'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:13.768724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] The token cache is being invalidate because project 5a2aef326833445393f285d0aad7fc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:13.769405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:13.770465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:13.773559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1036/2040] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:13 2022] DELETE /identity/v3/projects/5a2aef326833445393f285d0aad7fc1c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:13.780172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31eb94-d621-498c-a6a2-b0d681c349d5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:13.781036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31eb94-d621-498c-a6a2-b0d681c349d5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:13.781036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31eb94-d621-498c-a6a2-b0d681c349d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:13.818921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bd31eb94-d621-498c-a6a2-b0d681c349d5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:13.818921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bd31eb94-d621-498c-a6a2-b0d681c349d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:13.820065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:13.821150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:13.962546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1005/2041] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:13.969913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dd633-00a7-4499-b852-ab29d5e2fda4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:13.970419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dd633-00a7-4499-b852-ab29d5e2fda4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:13.971131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dd633-00a7-4499-b852-ab29d5e2fda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:13.971292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1389d3-5207-4c1b-ae67-70ed293417d1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:13.978052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:13.978793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:13.979070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:13.979515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] PATH_INFO: `/v3/users/de7ac457b1774df9aa97ec565dab0762` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:13.981581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7ac457b1774df9aa97ec565dab0762)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:13.984123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:14.030563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-521dd633-00a7-4499-b852-ab29d5e2fda4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:14.047608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-521dd633-00a7-4499-b852-ab29d5e2fda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:14.087446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1006/2042] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:14.089144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dd633-00a7-4499-b852-ab29d5e2fda4 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:14.104983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7ac457b1774df9aa97ec565dab0762'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:14.125245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dd633-00a7-4499-b852-ab29d5e2fda4 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:14.130039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7ac457b1774df9aa97ec565dab0762'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:14.135104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:14.135783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7ac457b1774df9aa97ec565dab0762'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:14.136172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.136515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.137054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.137823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:14.138223 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:14.144036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7ac457b1774df9aa97ec565dab0762'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:14.145716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:14.159496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-640d6d9f-33e6-4dd3-95ab-7f6869ee9ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7ac457b1774df9aa97ec565dab0762'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:14.175959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1007/2043] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:14.177733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:14.181300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:14.189701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1037/2044] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:13 2022] DELETE /identity/v3/users/de7ac457b1774df9aa97ec565dab0762 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:14.192276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad6bb-5bcb-4d5d-8562-ac0f05f916d3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.192634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad6bb-5bcb-4d5d-8562-ac0f05f916d3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.192987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad6bb-5bcb-4d5d-8562-ac0f05f916d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.211636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac72a2-35c3-40d4-927e-e35c4334eb1a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:14.223121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a57ad6bb-5bcb-4d5d-8562-ac0f05f916d3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:14.226611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a57ad6bb-5bcb-4d5d-8562-ac0f05f916d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:14.275632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:14.288400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:14.322513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1038/2045] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:14.333894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ad6bb-5bcb-4d5d-8562-ac0f05f916d3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:14.336550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a57ad6bb-5bcb-4d5d-8562-ac0f05f916d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:14.345933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568add01-4a5d-4e30-8695-08cf78f9e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:14.347096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568add01-4a5d-4e30-8695-08cf78f9e814 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.347586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568add01-4a5d-4e30-8695-08cf78f9e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.348197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568add01-4a5d-4e30-8695-08cf78f9e814 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.349488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568add01-4a5d-4e30-8695-08cf78f9e814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:14.353765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568add01-4a5d-4e30-8695-08cf78f9e814 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:14.391046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1008/2046] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:14 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:14.395565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568add01-4a5d-4e30-8695-08cf78f9e814 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:14.428869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ad6bb-5bcb-4d5d-8562-ac0f05f916d3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:14.493410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86659e-4faa-4ad7-8252-cfa1839577ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:14.495344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86659e-4faa-4ad7-8252-cfa1839577ca service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.495344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86659e-4faa-4ad7-8252-cfa1839577ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.495344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86659e-4faa-4ad7-8252-cfa1839577ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.501244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568add01-4a5d-4e30-8695-08cf78f9e814 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:14.512079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17df3fe-8b88-4e11-bfa9-8158f31f8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:14.512733 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17df3fe-8b88-4e11-bfa9-8158f31f8a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.513014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17df3fe-8b88-4e11-bfa9-8158f31f8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.513318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17df3fe-8b88-4e11-bfa9-8158f31f8a8f admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.513883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86659e-4faa-4ad7-8252-cfa1839577ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:14.514047 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17df3fe-8b88-4e11-bfa9-8158f31f8a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:14.515514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86659e-4faa-4ad7-8252-cfa1839577ca service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:14.516484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17df3fe-8b88-4e11-bfa9-8158f31f8a8f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:14.536129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1039/2047] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:45:14.546916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1009/2048] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:14 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:14.549579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86659e-4faa-4ad7-8252-cfa1839577ca service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:14.564576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86659e-4faa-4ad7-8252-cfa1839577ca service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:14.574618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d649b90-c6f1-40bb-ac77-b05f7c0ae59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:14.575634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d649b90-c6f1-40bb-ac77-b05f7c0ae59f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.576060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d649b90-c6f1-40bb-ac77-b05f7c0ae59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.577153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d649b90-c6f1-40bb-ac77-b05f7c0ae59f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.578038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d649b90-c6f1-40bb-ac77-b05f7c0ae59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:14.579869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d649b90-c6f1-40bb-ac77-b05f7c0ae59f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:14.615841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17df3fe-8b88-4e11-bfa9-8158f31f8a8f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:14.618184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1040/2049] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:14.634161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17df3fe-8b88-4e11-bfa9-8158f31f8a8f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:14.641404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f1042-6f3a-4452-887c-6762984e59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:14.642161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1042-6f3a-4452-887c-6762984e59bb admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.642606 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1042-6f3a-4452-887c-6762984e59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.643062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1042-6f3a-4452-887c-6762984e59bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.644014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f1042-6f3a-4452-887c-6762984e59bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:14.646478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f1042-6f3a-4452-887c-6762984e59bb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:14.670651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1010/2050] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:45:14.674530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d649b90-c6f1-40bb-ac77-b05f7c0ae59f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:14.695484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d649b90-c6f1-40bb-ac77-b05f7c0ae59f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:14.711631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:14.713106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.713709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.714312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] PATH_INFO: `/v3/projects/7976ea592d544da08c5102f5d97ac396/users/b8e3203a64914016a86d84b1aae3a496/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.759742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7976ea592d544da08c5102f5d97ac396, user_id=b8e3203a64914016a86d84b1aae3a496, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:14.765218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:14.796283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1041/2051] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:14 2022] PUT /identity/v3/projects/7976ea592d544da08c5102f5d97ac396/users/b8e3203a64914016a86d84b1aae3a496/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:14.800191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385653f7-49de-4abc-ad59-a0a7ecdb69c8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:14.801114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385653f7-49de-4abc-ad59-a0a7ecdb69c8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:14.801114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385653f7-49de-4abc-ad59-a0a7ecdb69c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:14.860524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-385653f7-49de-4abc-ad59-a0a7ecdb69c8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:14.865254 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-385653f7-49de-4abc-ad59-a0a7ecdb69c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:14.898342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:14.901948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:15.087899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1011/2052] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:15.104762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ec49e-e162-4244-976a-05fb5428c088 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:15.107462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385653f7-49de-4abc-ad59-a0a7ecdb69c8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:15.111060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:15.111789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:15.112068 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:15.112337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] PATH_INFO: `/v3/projects/937a0e44a54a4ae6ac86a0e0477b8ccc` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:15.113572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937a0e44a54a4ae6ac86a0e0477b8ccc)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:15.118860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:15.132579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:15.213509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:15.229422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937a0e44a54a4ae6ac86a0e0477b8ccc', 'request_id': 'req-b95095b4-aac7-4370-881e-325bcf209fd6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.269898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937a0e44a54a4ae6ac86a0e0477b8ccc', 'request_id': 'req-b95095b4-aac7-4370-881e-325bcf209fd6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.281306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385653f7-49de-4abc-ad59-a0a7ecdb69c8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:15.290624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937a0e44a54a4ae6ac86a0e0477b8ccc', 'request_id': 'req-b95095b4-aac7-4370-881e-325bcf209fd6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.322117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] The token cache is being invalidate because project 937a0e44a54a4ae6ac86a0e0477b8ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:15.322880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.323926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.329337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1042/2053] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:14 2022] DELETE /identity/v3/projects/937a0e44a54a4ae6ac86a0e0477b8ccc => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:15.330930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:15.332865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:15.398917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:15.399848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:15.400132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:15.400407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:15.402465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:15.464590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95095b4-aac7-4370-881e-325bcf209fd6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:15.478607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:15.479651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:15.480140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:15.480612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] PATH_INFO: `/v3/users/acdc97c05006416b938dd741e50838a9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:15.491745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:15.494237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:15.495048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdc97c05006416b938dd741e50838a9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:15.498294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:15.523193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1012/2054] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:45:15.527271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:15.530175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:15.590064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abe19a-62b5-4ed1-aacf-4e2ba8086e1a service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:15.615844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:15.615844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:15.615844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:15.615844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] PATH_INFO: `/v3/users/a587c056a80348b9bf3b553876719f05` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:15.617051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdc97c05006416b938dd741e50838a9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.619788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a587c056a80348b9bf3b553876719f05)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:15.623186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:15.663525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdc97c05006416b938dd741e50838a9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.666321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdc97c05006416b938dd741e50838a9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.675730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdc97c05006416b938dd741e50838a9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.709719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b0548065-6b27-430f-a90f-2d13095f9bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdc97c05006416b938dd741e50838a9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.749483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1043/2055] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:15 2022] DELETE /identity/v3/users/acdc97c05006416b938dd741e50838a9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:15.767268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a587c056a80348b9bf3b553876719f05'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.800472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a587c056a80348b9bf3b553876719f05'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.825642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a587c056a80348b9bf3b553876719f05'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.827452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a587c056a80348b9bf3b553876719f05'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.833235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a587c056a80348b9bf3b553876719f05'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:15.869730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1013/2056] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:15 2022] DELETE /identity/v3/users/a587c056a80348b9bf3b553876719f05 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:15.875889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0233-5cf6-47bf-ad46-a9ca4cd1036d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:15.876208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0233-5cf6-47bf-ad46-a9ca4cd1036d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:15.876499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e0233-5cf6-47bf-ad46-a9ca4cd1036d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:15.913411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a57e0233-5cf6-47bf-ad46-a9ca4cd1036d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:15.915731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a57e0233-5cf6-47bf-ad46-a9ca4cd1036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:15.939184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:16.030591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1044/2057] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:16.058845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:16.063294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:16.090478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:16.191694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e465112-d412-46f2-9232-dc314ce83994 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:16.223513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:16.224426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:16.225102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:16.225705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:16.239048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:16.241130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:16.257599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1014/2058] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:17.097535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947455-575a-4744-8f54-47595e0ceb84 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:17.098616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947455-575a-4744-8f54-47595e0ceb84 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:17.099114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947455-575a-4744-8f54-47595e0ceb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:17.154501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:17.156552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:17.195943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d264b-1fb1-4408-920d-cf7fdd167e20 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:17.211413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:17.214151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:17.214473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:17.215599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] PATH_INFO: `/v3/projects/740f25dd46e64bd1a90816c2e1417244` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:17.219816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=740f25dd46e64bd1a90816c2e1417244)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:17.226838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-18947455-575a-4744-8f54-47595e0ceb84 None None] MFA Rules not processed for user `b8e3203a64914016a86d84b1aae3a496`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:17.232845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:17.240224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-18947455-575a-4744-8f54-47595e0ceb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:17.389598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740f25dd46e64bd1a90816c2e1417244', 'request_id': 'req-59d4c3e5-1444-4aad-b293-7004e7610c14'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.423489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740f25dd46e64bd1a90816c2e1417244', 'request_id': 'req-59d4c3e5-1444-4aad-b293-7004e7610c14'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.440354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1045/2059] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:17.441635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18947455-575a-4744-8f54-47595e0ceb84 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:17.445150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-18947455-575a-4744-8f54-47595e0ceb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:17.452803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740f25dd46e64bd1a90816c2e1417244', 'request_id': 'req-59d4c3e5-1444-4aad-b293-7004e7610c14'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.483574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] The token cache is being invalidate because project 740f25dd46e64bd1a90816c2e1417244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:17.484078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.486188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.493377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1015/2060] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:17 2022] DELETE /identity/v3/projects/740f25dd46e64bd1a90816c2e1417244 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:17.495654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:17.504173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:17.505223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18947455-575a-4744-8f54-47595e0ceb84 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:17.682577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:17.683874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:17.684371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:17.685237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] PATH_INFO: `/v3/projects/4fb725dd6fa94262b51b277e11491013` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:17.687470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb725dd6fa94262b51b277e11491013)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:17.692323 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:17.705432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4c3e5-1444-4aad-b293-7004e7610c14 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:17.726196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:17.726880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:17.727155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:17.727423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:17.728104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:17.737562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:17.826364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:17.828701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb725dd6fa94262b51b277e11491013', 'request_id': 'req-8ec5b769-d587-4b4e-a4e1-15e4286cc495'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.844909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb725dd6fa94262b51b277e11491013', 'request_id': 'req-8ec5b769-d587-4b4e-a4e1-15e4286cc495'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.851452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1016/2061] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:17 2022] POST /identity/v3/projects => generated 373 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:17.852426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:17.855444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:17.859558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb725dd6fa94262b51b277e11491013', 'request_id': 'req-8ec5b769-d587-4b4e-a4e1-15e4286cc495'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.905228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] The token cache is being invalidate because project 4fb725dd6fa94262b51b277e11491013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:17.906199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.907690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:17.911033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1046/2062] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:17 2022] DELETE /identity/v3/projects/4fb725dd6fa94262b51b277e11491013 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:17.912467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:17.915009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:17.928842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:17.988534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33091c87-74c7-436c-8386-63cc0e36e787 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:18.001282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:18.002145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.002659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.003022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] PATH_INFO: `/v3/users/7b962ae9384548a4845b0c9f5cd111fb` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.004791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b962ae9384548a4845b0c9f5cd111fb)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:18.008586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:18.106221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5b769-d587-4b4e-a4e1-15e4286cc495 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:18.120873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6557b9-2abe-498e-b768-d68dc6709d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:18.123065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6557b9-2abe-498e-b768-d68dc6709d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.123866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6557b9-2abe-498e-b768-d68dc6709d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.125203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6557b9-2abe-498e-b768-d68dc6709d1c admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.126088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6557b9-2abe-498e-b768-d68dc6709d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:18.131090 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6557b9-2abe-498e-b768-d68dc6709d1c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:18.133667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b962ae9384548a4845b0c9f5cd111fb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:18.182194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1047/2063] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:17 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:18.184677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e5382-ffdc-483c-bb70-0a5e59e33bc4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.185273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e5382-ffdc-483c-bb70-0a5e59e33bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.185697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e5382-ffdc-483c-bb70-0a5e59e33bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.212559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b962ae9384548a4845b0c9f5cd111fb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:18.224223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c67e5382-ffdc-483c-bb70-0a5e59e33bc4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:18.229052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c67e5382-ffdc-483c-bb70-0a5e59e33bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:18.249995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b962ae9384548a4845b0c9f5cd111fb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:18.249995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b962ae9384548a4845b0c9f5cd111fb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:18.250824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3494588e-8244-4e94-8c97-e0d3076d8d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b962ae9384548a4845b0c9f5cd111fb'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:18.261070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1048/2064] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:18.261297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e5382-ffdc-483c-bb70-0a5e59e33bc4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:18.274428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e5382-ffdc-483c-bb70-0a5e59e33bc4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:18.293172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:18.293852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.294496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.294496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.295062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:18.301582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:18.303344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1017/2065] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:17 2022] DELETE /identity/v3/users/7b962ae9384548a4845b0c9f5cd111fb => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:18.307354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5189c-2329-42d9-b406-81611aedcadd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.321377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5189c-2329-42d9-b406-81611aedcadd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.322216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5189c-2329-42d9-b406-81611aedcadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.330495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1049/2066] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:18.339348 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:18.342046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:18.369193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec617a-9f57-463e-b3ca-93aba2ba1cc3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:18.386339 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-91f5189c-2329-42d9-b406-81611aedcadd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:18.390895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-91f5189c-2329-42d9-b406-81611aedcadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:18.525723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d7a0a-2654-4885-9877-20b2b8e413e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:18.526341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d7a0a-2654-4885-9877-20b2b8e413e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.526676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d7a0a-2654-4885-9877-20b2b8e413e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.526932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d7a0a-2654-4885-9877-20b2b8e413e6 admin admin] PATH_INFO: `/v3/projects/7c363752b88741eca618d48bb4ed6e3f/users/9913c6bcf263447bba6895822c209c62/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.544289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1018/2067] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:18.552538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5189c-2329-42d9-b406-81611aedcadd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:18.567802 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d7a0a-2654-4885-9877-20b2b8e413e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c363752b88741eca618d48bb4ed6e3f, user_id=9913c6bcf263447bba6895822c209c62, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:18.572008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d7a0a-2654-4885-9877-20b2b8e413e6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:18.592641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5189c-2329-42d9-b406-81611aedcadd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:18.605389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1050/2068] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:18 2022] PUT /identity/v3/projects/7c363752b88741eca618d48bb4ed6e3f/users/9913c6bcf263447bba6895822c209c62/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:18.607818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d7a0a-2654-4885-9877-20b2b8e413e6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:18.716413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:18.737243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:18.786525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d7a0a-2654-4885-9877-20b2b8e413e6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:18.791372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:18.792396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.792849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.793289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.794152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:18.794684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:18.796671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:18.798873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b251a-3f79-41a0-9751-4927322e1a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:18.799997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b251a-3f79-41a0-9751-4927322e1a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.800528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b251a-3f79-41a0-9751-4927322e1a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.800980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b251a-3f79-41a0-9751-4927322e1a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.802175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b251a-3f79-41a0-9751-4927322e1a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:18.810554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b251a-3f79-41a0-9751-4927322e1a7a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:18.835841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1019/2069] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:18.840244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:18.851210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1051/2070] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:18.855275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b251a-3f79-41a0-9751-4927322e1a7a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:18.884464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581608a-e578-4f4f-b48f-5401fb5aeb42 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:18.890601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b251a-3f79-41a0-9751-4927322e1a7a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:18.901547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:18.904689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.905873 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.906860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.909367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:18.911437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2925bd9-5161-43ee-88df-179ffad6505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:18.915009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2925bd9-5161-43ee-88df-179ffad6505a admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:18.916192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2925bd9-5161-43ee-88df-179ffad6505a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:18.930788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2925bd9-5161-43ee-88df-179ffad6505a admin admin] PATH_INFO: `/v3/projects/7c363752b88741eca618d48bb4ed6e3f/users/9913c6bcf263447bba6895822c209c62/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:18.934428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:18.946028 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2925bd9-5161-43ee-88df-179ffad6505a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c363752b88741eca618d48bb4ed6e3f, user_id=9913c6bcf263447bba6895822c209c62, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:18.948887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2925bd9-5161-43ee-88df-179ffad6505a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:18.979320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1052/2071] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:18 2022] PUT /identity/v3/projects/7c363752b88741eca618d48bb4ed6e3f/users/9913c6bcf263447bba6895822c209c62/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:19.009653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1020/2072] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:18 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:19.014336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2925bd9-5161-43ee-88df-179ffad6505a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:19.158273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:19.160130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:19.169345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2925bd9-5161-43ee-88df-179ffad6505a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:19.300049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:19.300362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67b98-c7f6-467b-ac82-ca79c936be09 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:19.301464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.301943 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.302546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.303910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:19.307196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:19.308155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.308309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:19.308408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.308499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] PATH_INFO: `/v3/projects/1e277e336a8240e9a054789da3cf8f51` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.309708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e277e336a8240e9a054789da3cf8f51)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:19.311752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:19.349551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1053/2073] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:19 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:19.351536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:19.355491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:19.375427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5160c3-ce47-43e2-9d3b-eb13034602d7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:19.388372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e277e336a8240e9a054789da3cf8f51', 'request_id': 'req-4c7f0770-7df7-4339-949b-8ce6fd0febfa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.399920 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e277e336a8240e9a054789da3cf8f51', 'request_id': 'req-4c7f0770-7df7-4339-949b-8ce6fd0febfa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.418494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e277e336a8240e9a054789da3cf8f51', 'request_id': 'req-4c7f0770-7df7-4339-949b-8ce6fd0febfa'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.442147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] The token cache is being invalidate because project 1e277e336a8240e9a054789da3cf8f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:19.442650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.443748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.446683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1021/2074] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:19 2022] DELETE /identity/v3/projects/1e277e336a8240e9a054789da3cf8f51 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:19.447315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:19.449173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:19.488975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:19.514884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:19.517787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.518340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.519061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] PATH_INFO: `/v3/users/96fb8269dcc14300912fb686e47b988f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.521266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fb8269dcc14300912fb686e47b988f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:19.527402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:19.541964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:19.580214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f0770-7df7-4339-949b-8ce6fd0febfa admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:19.590064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00e617-395e-4bfa-a2a1-0964466e1867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:19.590865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e617-395e-4bfa-a2a1-0964466e1867 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.591240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e617-395e-4bfa-a2a1-0964466e1867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.591759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00e617-395e-4bfa-a2a1-0964466e1867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.592504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e617-395e-4bfa-a2a1-0964466e1867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:19.594996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00e617-395e-4bfa-a2a1-0964466e1867 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:19.603287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fb8269dcc14300912fb686e47b988f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.614121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1022/2075] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:19.614121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b943a7-fbd0-48ff-ae8f-bcbf29683ea2 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.614121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b943a7-fbd0-48ff-ae8f-bcbf29683ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.614121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b943a7-fbd0-48ff-ae8f-bcbf29683ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.638263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fb8269dcc14300912fb686e47b988f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.639497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fb8269dcc14300912fb686e47b988f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.640461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fb8269dcc14300912fb686e47b988f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.644685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-21b943a7-fbd0-48ff-ae8f-bcbf29683ea2 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:19.648109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-21b943a7-fbd0-48ff-ae8f-bcbf29683ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:19.659498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1023/2076] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:19.668708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8ffee01f-a8c0-4787-93f0-7d54ef15433e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fb8269dcc14300912fb686e47b988f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:19.672865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b943a7-fbd0-48ff-ae8f-bcbf29683ea2 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:19.676142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-21b943a7-fbd0-48ff-ae8f-bcbf29683ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:19.692264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1054/2077] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:19 2022] DELETE /identity/v3/users/96fb8269dcc14300912fb686e47b988f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:19.697177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3e35-591e-45a6-986c-8b1c51a541ba None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.699249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3e35-591e-45a6-986c-8b1c51a541ba None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.699694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3e35-591e-45a6-986c-8b1c51a541ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.712884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b943a7-fbd0-48ff-ae8f-bcbf29683ea2 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:19.736714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a34c3e35-591e-45a6-986c-8b1c51a541ba None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:19.742202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a34c3e35-591e-45a6-986c-8b1c51a541ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:19.827807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1055/2078] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:19.830059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffe8ac-d1c0-496a-8429-29e7405d07f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:19.831030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffe8ac-d1c0-496a-8429-29e7405d07f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.831510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffe8ac-d1c0-496a-8429-29e7405d07f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.831918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffe8ac-d1c0-496a-8429-29e7405d07f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.832782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffe8ac-d1c0-496a-8429-29e7405d07f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:19.833162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3e35-591e-45a6-986c-8b1c51a541ba None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:19.835765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffe8ac-d1c0-496a-8429-29e7405d07f1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:19.847206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3e35-591e-45a6-986c-8b1c51a541ba None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:19.859470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1024/2079] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:19.862962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:19.863770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.864119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.865161 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.866001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:19.866394 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:19.866730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffe8ac-d1c0-496a-8429-29e7405d07f1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:19.868366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:19.891741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1056/2080] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:19.892587 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:19.897827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffe8ac-d1c0-496a-8429-29e7405d07f1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:19.917859 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f12a8d-ed5b-4a11-b921-b4866e26b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:19.919689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12a8d-ed5b-4a11-b921-b4866e26b154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.920424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12a8d-ed5b-4a11-b921-b4866e26b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.920995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12a8d-ed5b-4a11-b921-b4866e26b154 admin admin] PATH_INFO: `/v3/projects/060ae45805cf43899affa4cdf38fdd90/users/79de373295a34fd29057a5ada98f4100/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.928009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8fc1-70f3-4292-b564-f5d249f0b587 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:19.941052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c751-859f-4545-82bd-68aaabaf1e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:19.942231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c751-859f-4545-82bd-68aaabaf1e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:19.942856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c751-859f-4545-82bd-68aaabaf1e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:19.943410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c751-859f-4545-82bd-68aaabaf1e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:19.944885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8c751-859f-4545-82bd-68aaabaf1e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:19.950983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8c751-859f-4545-82bd-68aaabaf1e59 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:19.964291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f12a8d-ed5b-4a11-b921-b4866e26b154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060ae45805cf43899affa4cdf38fdd90, user_id=79de373295a34fd29057a5ada98f4100, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:19.967131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f12a8d-ed5b-4a11-b921-b4866e26b154 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:19.994436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1025/2081] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:19 2022] PUT /identity/v3/projects/060ae45805cf43899affa4cdf38fdd90/users/79de373295a34fd29057a5ada98f4100/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:20.005872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe27f7-d1cc-4bd9-8d63-5b37c699a313 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.006155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe27f7-d1cc-4bd9-8d63-5b37c699a313 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.007292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe27f7-d1cc-4bd9-8d63-5b37c699a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.024285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1057/2082] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:19 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:20.026990 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c751-859f-4545-82bd-68aaabaf1e59 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.087574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-80fe27f7-d1cc-4bd9-8d63-5b37c699a313 None None] MFA Rules not processed for user `79de373295a34fd29057a5ada98f4100`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:20.088884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-80fe27f7-d1cc-4bd9-8d63-5b37c699a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:20.089457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:20.140493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c751-859f-4545-82bd-68aaabaf1e59 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.162219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9304a68-ac1b-44e0-9d14-4221a70cf662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.164631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9304a68-ac1b-44e0-9d14-4221a70cf662 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.165698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9304a68-ac1b-44e0-9d14-4221a70cf662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.167934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9304a68-ac1b-44e0-9d14-4221a70cf662 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.168908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9304a68-ac1b-44e0-9d14-4221a70cf662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.171872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9304a68-ac1b-44e0-9d14-4221a70cf662 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.200609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1058/2083] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:20 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:20.207600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9304a68-ac1b-44e0-9d14-4221a70cf662 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.221030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1026/2084] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:20.226817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe27f7-d1cc-4bd9-8d63-5b37c699a313 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.242186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9304a68-ac1b-44e0-9d14-4221a70cf662 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.243419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe27f7-d1cc-4bd9-8d63-5b37c699a313 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.249724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e980fc-24dc-432b-bc88-0578e9d707f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.250609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e980fc-24dc-432b-bc88-0578e9d707f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.250999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e980fc-24dc-432b-bc88-0578e9d707f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.251392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e980fc-24dc-432b-bc88-0578e9d707f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.252473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e980fc-24dc-432b-bc88-0578e9d707f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.254338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.255391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.255555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e980fc-24dc-432b-bc88-0578e9d707f4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.256597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.257059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.258489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.262845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.299053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1059/2085] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:20.301067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.303866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1027/2086] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:20 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:20.308376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:20.309148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e980fc-24dc-432b-bc88-0578e9d707f4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.355798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573a28a-65cf-47da-8e35-e8584b1ce786 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.379625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:20.445564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.446438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.446776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.447147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] PATH_INFO: `/v3/projects/5ba8340939244ecab134924353f7973d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.448697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba8340939244ecab134924353f7973d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.451222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.464872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e980fc-24dc-432b-bc88-0578e9d707f4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.470841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8371dc-14e5-4cb4-ba77-05bc19a6a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.471485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8371dc-14e5-4cb4-ba77-05bc19a6a18e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.471821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8371dc-14e5-4cb4-ba77-05bc19a6a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.472083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8371dc-14e5-4cb4-ba77-05bc19a6a18e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.472835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8371dc-14e5-4cb4-ba77-05bc19a6a18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.474951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8371dc-14e5-4cb4-ba77-05bc19a6a18e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.489686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1028/2087] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:20.490623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8371dc-14e5-4cb4-ba77-05bc19a6a18e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.504675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8371dc-14e5-4cb4-ba77-05bc19a6a18e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.511966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.512602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.512883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.513149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.513797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.515863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.543827 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba8340939244ecab134924353f7973d', 'request_id': 'req-32201b2b-1ee5-4506-9333-d0ec77e627c6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.547197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1029/2088] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:20 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:20.548292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.550919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:20.555566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba8340939244ecab134924353f7973d', 'request_id': 'req-32201b2b-1ee5-4506-9333-d0ec77e627c6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.564234 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba8340939244ecab134924353f7973d', 'request_id': 'req-32201b2b-1ee5-4506-9333-d0ec77e627c6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.570246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc77d32-4221-4ee9-933c-c429b034cb54 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.584439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] The token cache is being invalidate because project 5ba8340939244ecab134924353f7973d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:20.584439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.584439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-32201b2b-1ee5-4506-9333-d0ec77e627c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.587567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1060/2089] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:20 2022] DELETE /identity/v3/projects/5ba8340939244ecab134924353f7973d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:20.591717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31ca5f-1389-4185-9e14-67466a0e7e44 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.591717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31ca5f-1389-4185-9e14-67466a0e7e44 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.591717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31ca5f-1389-4185-9e14-67466a0e7e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.630088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-cf31ca5f-1389-4185-9e14-67466a0e7e44 None None] MFA Rules not processed for user `9913c6bcf263447bba6895822c209c62`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:20.631919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cf31ca5f-1389-4185-9e14-67466a0e7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:20.657921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.658690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.658973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.659248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] PATH_INFO: `/v3/users/f8cf2e1faf1942df8f0bcbeccd34b0ba` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.660672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8cf2e1faf1942df8f0bcbeccd34b0ba)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.663222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.689644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:20.729565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8cf2e1faf1942df8f0bcbeccd34b0ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.745285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1061/2090] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:20.746843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31ca5f-1389-4185-9e14-67466a0e7e44 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.748498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cf31ca5f-1389-4185-9e14-67466a0e7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:20.757665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8cf2e1faf1942df8f0bcbeccd34b0ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.763213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31ca5f-1389-4185-9e14-67466a0e7e44 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.768058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7b90a-5064-45ba-a579-084a0add331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.768748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7b90a-5064-45ba-a579-084a0add331c admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.769025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7b90a-5064-45ba-a579-084a0add331c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.769295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7b90a-5064-45ba-a579-084a0add331c admin admin] PATH_INFO: `/v3/projects/dcfcd8e87dd74fe0a49dcc3b79924b2e/users/e0609193d41f4a808ae0e74aae61ebe4/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.771949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8cf2e1faf1942df8f0bcbeccd34b0ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.773235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8cf2e1faf1942df8f0bcbeccd34b0ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.774257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8cf2e1faf1942df8f0bcbeccd34b0ba'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:20.788011 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7b90a-5064-45ba-a579-084a0add331c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfcd8e87dd74fe0a49dcc3b79924b2e, user_id=e0609193d41f4a808ae0e74aae61ebe4, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.790757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7b90a-5064-45ba-a579-084a0add331c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.796040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1030/2091] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:20 2022] DELETE /identity/v3/users/f8cf2e1faf1942df8f0bcbeccd34b0ba => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:20.797579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:20.800725 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:20.807787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1062/2092] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:20 2022] PUT /identity/v3/projects/dcfcd8e87dd74fe0a49dcc3b79924b2e/users/e0609193d41f4a808ae0e74aae61ebe4/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:20.817110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea7380-3fdc-4374-ac94-76e971817365 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.817767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea7380-3fdc-4374-ac94-76e971817365 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.818239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea7380-3fdc-4374-ac94-76e971817365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.820322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:20.848764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6cea7380-3fdc-4374-ac94-76e971817365 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:20.850961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6cea7380-3fdc-4374-ac94-76e971817365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:20.882801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b45be-88e7-4529-98c0-5ba12dcc60c8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:20.922714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1063/2093] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:20.924267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85480-a46c-4873-9a65-5040589d04ca None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.924544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85480-a46c-4873-9a65-5040589d04ca None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.925138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85480-a46c-4873-9a65-5040589d04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.948255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-daf85480-a46c-4873-9a65-5040589d04ca None None] MFA Rules not processed for user `b8e3203a64914016a86d84b1aae3a496`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:20.949773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-daf85480-a46c-4873-9a65-5040589d04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:20.965294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ed52b-94fb-4f51-a1e3-018682f4a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:20.965950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed52b-94fb-4f51-a1e3-018682f4a323 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.966222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed52b-94fb-4f51-a1e3-018682f4a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.966546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed52b-94fb-4f51-a1e3-018682f4a323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:20.967257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ed52b-94fb-4f51-a1e3-018682f4a323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:20.968904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ed52b-94fb-4f51-a1e3-018682f4a323 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:20.982345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1031/2094] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:20.985318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421cfd-3b9b-4f95-b7e8-3c4dd5f333e5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:20.985318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421cfd-3b9b-4f95-b7e8-3c4dd5f333e5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:20.985318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421cfd-3b9b-4f95-b7e8-3c4dd5f333e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.007994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-69421cfd-3b9b-4f95-b7e8-3c4dd5f333e5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:21.009287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-69421cfd-3b9b-4f95-b7e8-3c4dd5f333e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.018143 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1032/2095] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:21.019490 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ec994-a182-48ae-ae1e-3ab7532229e1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.019776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ec994-a182-48ae-ae1e-3ab7532229e1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.020046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ec994-a182-48ae-ae1e-3ab7532229e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.022703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1064/2096] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:21.025513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531899-665d-403f-8ee0-2fec5df98ca6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.025882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531899-665d-403f-8ee0-2fec5df98ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.026481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531899-665d-403f-8ee0-2fec5df98ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.056872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c0531899-665d-403f-8ee0-2fec5df98ca6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:21.058553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c0531899-665d-403f-8ee0-2fec5df98ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.059083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-da4ec994-a182-48ae-ae1e-3ab7532229e1 None None] MFA Rules not processed for user `e0609193d41f4a808ae0e74aae61ebe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:21.060408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-da4ec994-a182-48ae-ae1e-3ab7532229e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.068200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1065/2097] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:21.070072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0531899-665d-403f-8ee0-2fec5df98ca6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.081948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0531899-665d-403f-8ee0-2fec5df98ca6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.088460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.089384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.089753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.090117 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.090916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.092828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.105473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1066/2098] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:21.106713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.112371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.171642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1033/2099] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:21.171642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ec994-a182-48ae-ae1e-3ab7532229e1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.174135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:21.180723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-da4ec994-a182-48ae-ae1e-3ab7532229e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.208103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c8c69-ea7c-40a9-8965-7348e52e9b3b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.212908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a381a-282a-40a2-bdb9-d52e3d2a1c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.213847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a381a-282a-40a2-bdb9-d52e3d2a1c5a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.214202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a381a-282a-40a2-bdb9-d52e3d2a1c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.214583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a381a-282a-40a2-bdb9-d52e3d2a1c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.225620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a381a-282a-40a2-bdb9-d52e3d2a1c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.227335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a381a-282a-40a2-bdb9-d52e3d2a1c5a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.241113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:21.248765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1067/2100] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:21.250351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a381a-282a-40a2-bdb9-d52e3d2a1c5a service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.267878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a381a-282a-40a2-bdb9-d52e3d2a1c5a service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.275190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.275887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.276185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.276480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.277182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:21.277486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.279188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.285440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ec994-a182-48ae-ae1e-3ab7532229e1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.293161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.293830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.294071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.294368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.297221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.311072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1068/2101] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:21.312322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.325545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.328290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.337212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70435-d7b4-4c27-a2fd-fa4f6300d1c2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.343103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1034/2102] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:21.344400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a12c3-b4fa-4d1c-90fb-810b1b5d187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.344601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.345294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a12c3-b4fa-4d1c-90fb-810b1b5d187b admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.345606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a12c3-b4fa-4d1c-90fb-810b1b5d187b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.345882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a12c3-b4fa-4d1c-90fb-810b1b5d187b admin admin] PATH_INFO: `/v3/projects/0e8c7623a9294cab9aed653b783cf8d6/users/095d9a27024f4e77ae842da09e6eba37/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.346008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.364872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae178ed-c127-47a3-8567-782d191da950 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.370655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a12c3-b4fa-4d1c-90fb-810b1b5d187b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8c7623a9294cab9aed653b783cf8d6, user_id=095d9a27024f4e77ae842da09e6eba37, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.373691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a12c3-b4fa-4d1c-90fb-810b1b5d187b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.375583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164a71a-c605-4c43-80bc-2b3871f1d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.376118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a71a-c605-4c43-80bc-2b3871f1d603 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.376788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a71a-c605-4c43-80bc-2b3871f1d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.377240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a71a-c605-4c43-80bc-2b3871f1d603 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.378770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164a71a-c605-4c43-80bc-2b3871f1d603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.383071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164a71a-c605-4c43-80bc-2b3871f1d603 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.393595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1069/2103] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:21 2022] PUT /identity/v3/projects/0e8c7623a9294cab9aed653b783cf8d6/users/095d9a27024f4e77ae842da09e6eba37/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:21.394109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a12c3-b4fa-4d1c-90fb-810b1b5d187b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.476529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1035/2104] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:21 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:21.479793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257272-a226-4bda-b213-9eca9092c1f0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.480313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257272-a226-4bda-b213-9eca9092c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.480835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257272-a226-4bda-b213-9eca9092c1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.536487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b3257272-a226-4bda-b213-9eca9092c1f0 None None] MFA Rules not processed for user `095d9a27024f4e77ae842da09e6eba37`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:21.538734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b3257272-a226-4bda-b213-9eca9092c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.541202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a12c3-b4fa-4d1c-90fb-810b1b5d187b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.641055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658169-c465-45c7-8044-b6a0ee23495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.642308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658169-c465-45c7-8044-b6a0ee23495d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.643206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658169-c465-45c7-8044-b6a0ee23495d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.643695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658169-c465-45c7-8044-b6a0ee23495d admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.644733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10658169-c465-45c7-8044-b6a0ee23495d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.649190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10658169-c465-45c7-8044-b6a0ee23495d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.676002 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1036/2105] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:21.676002 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257272-a226-4bda-b213-9eca9092c1f0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.697140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257272-a226-4bda-b213-9eca9092c1f0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.707160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1070/2106] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:21 2022] POST /identity/v3/projects => generated 371 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:21.707833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658169-c465-45c7-8044-b6a0ee23495d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.708345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df05d-e222-4fb3-abd6-9923118ab0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.710767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df05d-e222-4fb3-abd6-9923118ab0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.711283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df05d-e222-4fb3-abd6-9923118ab0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.711785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df05d-e222-4fb3-abd6-9923118ab0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.712991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df05d-e222-4fb3-abd6-9923118ab0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.716812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df05d-e222-4fb3-abd6-9923118ab0f8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.755449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1037/2107] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:21 2022] POST /identity/v3/users => generated 290 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:21.756646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df05d-e222-4fb3-abd6-9923118ab0f8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.771932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df05d-e222-4fb3-abd6-9923118ab0f8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.781936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:21.856114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658169-c465-45c7-8044-b6a0ee23495d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:21.862196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be6a02-3afe-4624-a94c-199035b19aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.862962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6a02-3afe-4624-a94c-199035b19aab admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.863240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6a02-3afe-4624-a94c-199035b19aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.863535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6a02-3afe-4624-a94c-199035b19aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.864160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be6a02-3afe-4624-a94c-199035b19aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.866179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be6a02-3afe-4624-a94c-199035b19aab admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.883025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:21.884096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:21.884803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:21.885515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:21.886363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:21.890092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:21.908614 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1071/2108] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:21 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:21.909795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be6a02-3afe-4624-a94c-199035b19aab admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.941109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1038/2109] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:21 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:21.941109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:21.946513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:21.962544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:21.969838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3196a-9439-4d22-ade3-ed60c8debe73 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.016145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be6a02-3afe-4624-a94c-199035b19aab admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.021390 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2707d3-c608-4140-b7c5-5061c6f8662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.022148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2707d3-c608-4140-b7c5-5061c6f8662f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.022530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2707d3-c608-4140-b7c5-5061c6f8662f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.023357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2707d3-c608-4140-b7c5-5061c6f8662f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.023608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2707d3-c608-4140-b7c5-5061c6f8662f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.025319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2707d3-c608-4140-b7c5-5061c6f8662f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.037856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1072/2110] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:22.038854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2707d3-c608-4140-b7c5-5061c6f8662f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.049476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2707d3-c608-4140-b7c5-5061c6f8662f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.055644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b76753-eaa8-4634-9336-5fd14f95eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.056562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b76753-eaa8-4634-9336-5fd14f95eb1c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.056981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b76753-eaa8-4634-9336-5fd14f95eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.057326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b76753-eaa8-4634-9336-5fd14f95eb1c admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.058064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b76753-eaa8-4634-9336-5fd14f95eb1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.060167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b76753-eaa8-4634-9336-5fd14f95eb1c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.069705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.070891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.071389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.071864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] PATH_INFO: `/v3/projects/37d2e742c2c948ffa022cc4446b5e257` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.073830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d2e742c2c948ffa022cc4446b5e257)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.078020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.092358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1073/2111] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:22 2022] POST /identity/v3/users => generated 299 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:22.093236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b76753-eaa8-4634-9336-5fd14f95eb1c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.104113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b76753-eaa8-4634-9336-5fd14f95eb1c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.109544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75154d68-b3c9-4f4c-b6ea-eeccb28a0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.110187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75154d68-b3c9-4f4c-b6ea-eeccb28a0f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.110511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75154d68-b3c9-4f4c-b6ea-eeccb28a0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.111001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75154d68-b3c9-4f4c-b6ea-eeccb28a0f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.111444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75154d68-b3c9-4f4c-b6ea-eeccb28a0f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.113099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75154d68-b3c9-4f4c-b6ea-eeccb28a0f1b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.126928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1074/2112] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:22.126928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75154d68-b3c9-4f4c-b6ea-eeccb28a0f1b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.142492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75154d68-b3c9-4f4c-b6ea-eeccb28a0f1b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.151914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b8e11-cce5-44f5-8452-802ef45926bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.153160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8e11-cce5-44f5-8452-802ef45926bc admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.153655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8e11-cce5-44f5-8452-802ef45926bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.154187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8e11-cce5-44f5-8452-802ef45926bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.155398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b8e11-cce5-44f5-8452-802ef45926bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.158676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b8e11-cce5-44f5-8452-802ef45926bc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.177862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d2e742c2c948ffa022cc4446b5e257', 'request_id': 'req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.179279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1075/2113] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:22.184399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b8e11-cce5-44f5-8452-802ef45926bc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.186672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d2e742c2c948ffa022cc4446b5e257', 'request_id': 'req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.204487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d2e742c2c948ffa022cc4446b5e257', 'request_id': 'req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.222556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] The token cache is being invalidate because project 37d2e742c2c948ffa022cc4446b5e257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:22.222872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.226731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b8e11-cce5-44f5-8452-802ef45926bc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.229132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.233786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1039/2114] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:21 2022] DELETE /identity/v3/projects/37d2e742c2c948ffa022cc4446b5e257 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:22.239238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.243596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:22.333667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2ab9d-c10f-4b74-a470-05ce4804d9ac admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.342004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.342513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.342793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.343128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.344151 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.346108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.390034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1040/2115] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:22.390034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.394120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:22.415612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.418926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.420242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.420840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.422923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.426561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.440407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f940f3-2e57-4af2-b93d-72d4ffe1053b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.449990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0805f-3061-4c9d-839f-55d6875468f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.451218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0805f-3061-4c9d-839f-55d6875468f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.451687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0805f-3061-4c9d-839f-55d6875468f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.452155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0805f-3061-4c9d-839f-55d6875468f4 admin admin] PATH_INFO: `/v3/projects/7261108a76444427a41aab7ee38c820f/users/7b0b748b59dd46659fa9628408ad50f7/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.462295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1076/2116] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:22.464133 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.466909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:22.475519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0805f-3061-4c9d-839f-55d6875468f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7261108a76444427a41aab7ee38c820f, user_id=7b0b748b59dd46659fa9628408ad50f7, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.478687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0805f-3061-4c9d-839f-55d6875468f4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.488314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bb83d-71b8-4df6-9cee-3bf3f55d55a0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.497037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:22.508050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1041/2117] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:22 2022] PUT /identity/v3/projects/7261108a76444427a41aab7ee38c820f/users/7b0b748b59dd46659fa9628408ad50f7/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:22.509192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0805f-3061-4c9d-839f-55d6875468f4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.519889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:22.595210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.595940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.596333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.596676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] PATH_INFO: `/v3/users/a0c1183f33934328a1ac20b1f540b1b7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.599308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c1183f33934328a1ac20b1f540b1b7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.602642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.654584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0805f-3061-4c9d-839f-55d6875468f4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.654584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.654584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.655075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.655075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] PATH_INFO: `/v3/projects/6a9667abdf6c4d569238d57bc57a18cf/users/20231d53fd4346329cfc403cf231d093/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.676102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c1183f33934328a1ac20b1f540b1b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.678250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9667abdf6c4d569238d57bc57a18cf, user_id=20231d53fd4346329cfc403cf231d093, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.682953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.695534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c1183f33934328a1ac20b1f540b1b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.697002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c1183f33934328a1ac20b1f540b1b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.698140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c1183f33934328a1ac20b1f540b1b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.701475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1042/2118] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:22 2022] PUT /identity/v3/projects/6a9667abdf6c4d569238d57bc57a18cf/users/20231d53fd4346329cfc403cf231d093/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:22.702394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.704378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:22.721200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-cfb01634-f8f9-492e-865b-cc1d79e273ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c1183f33934328a1ac20b1f540b1b7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:22.743042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1077/2119] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:22 2022] DELETE /identity/v3/users/a0c1183f33934328a1ac20b1f540b1b7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:22.756419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871da0-4b31-4b1c-939a-93ef353f5ce2 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.756749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871da0-4b31-4b1c-939a-93ef353f5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.757071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871da0-4b31-4b1c-939a-93ef353f5ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.792031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-86871da0-4b31-4b1c-939a-93ef353f5ce2 None None] MFA Rules not processed for user `7b0b748b59dd46659fa9628408ad50f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:22.793302 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-86871da0-4b31-4b1c-939a-93ef353f5ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:22.814764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e688ba-cec5-4bf9-a667-e1ac45862f96 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:22.874535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1078/2120] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:22.875922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555968a-be5c-430a-85cf-12e74071c469 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.876265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555968a-be5c-430a-85cf-12e74071c469 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.876547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555968a-be5c-430a-85cf-12e74071c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.906683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:22.907329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:22.907607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:22.907867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] PATH_INFO: `/v3/projects/f1edc16781ce448d8a862efaed7c9b86/users/1d57068640e94627949955d989622828/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:22.918860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3555968a-be5c-430a-85cf-12e74071c469 None None] MFA Rules not processed for user `20231d53fd4346329cfc403cf231d093`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:22.920329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3555968a-be5c-430a-85cf-12e74071c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:22.927525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:22.942559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1edc16781ce448d8a862efaed7c9b86, user_id=1d57068640e94627949955d989622828, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:22.948137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:22.975640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1043/2121] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:22 2022] PUT /identity/v3/projects/f1edc16781ce448d8a862efaed7c9b86/users/1d57068640e94627949955d989622828/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:22.978210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:22.982223 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.039414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1079/2122] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:23.040289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555968a-be5c-430a-85cf-12e74071c469 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.058178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:23.061433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555968a-be5c-430a-85cf-12e74071c469 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.160898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.161598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.161882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.162203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.163178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.165343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.179108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1080/2123] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:23.183511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.188085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.193742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9fd78-081f-4c0c-8624-56321c1fdc5c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.208461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659b0b2-a2eb-463e-baa0-d35b41d557b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.209167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b0b2-a2eb-463e-baa0-d35b41d557b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.209332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b0b2-a2eb-463e-baa0-d35b41d557b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.209671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b0b2-a2eb-463e-baa0-d35b41d557b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.210659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659b0b2-a2eb-463e-baa0-d35b41d557b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.213278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659b0b2-a2eb-463e-baa0-d35b41d557b3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.214869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4661152-3829-41e6-873b-f1343ec07e55 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.232426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.233657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.234268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.234848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.236078 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.240419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.268385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1044/2124] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:22 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:23.270930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659b0b2-a2eb-463e-baa0-d35b41d557b3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.293054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1081/2125] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:23 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:23.293925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.298003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.385131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659b0b2-a2eb-463e-baa0-d35b41d557b3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.409964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb009b2-9c48-443f-ac7e-eb68690b72f4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.423554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.425011 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.425461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.426038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] PATH_INFO: `/v3/projects/3f06e658a73c4d8aabf5193a52c46a1c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.428062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f06e658a73c4d8aabf5193a52c46a1c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.431041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.483209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:23.511978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f035-be82-4984-b786-844b6463fb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.513477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f035-be82-4984-b786-844b6463fb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.514093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f035-be82-4984-b786-844b6463fb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.514739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f035-be82-4984-b786-844b6463fb28 admin admin] PATH_INFO: `/v3/projects/f1edc16781ce448d8a862efaed7c9b86/users/1d57068640e94627949955d989622828/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.520527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2f035-be82-4984-b786-844b6463fb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1edc16781ce448d8a862efaed7c9b86, user_id=1d57068640e94627949955d989622828, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.525524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2f035-be82-4984-b786-844b6463fb28 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.545797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1045/2126] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:23 2022] PUT /identity/v3/projects/f1edc16781ce448d8a862efaed7c9b86/users/1d57068640e94627949955d989622828/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:23.547618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f035-be82-4984-b786-844b6463fb28 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.573913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f06e658a73c4d8aabf5193a52c46a1c', 'request_id': 'req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:23.582837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f06e658a73c4d8aabf5193a52c46a1c', 'request_id': 'req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:23.591185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f06e658a73c4d8aabf5193a52c46a1c', 'request_id': 'req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:23.609341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] The token cache is being invalidate because project 3f06e658a73c4d8aabf5193a52c46a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:23.609736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:23.610423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:23.612380 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1082/2127] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:23 2022] DELETE /identity/v3/projects/3f06e658a73c4d8aabf5193a52c46a1c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:23.613319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.614915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.638643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:23.661431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f035-be82-4984-b786-844b6463fb28 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.669741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eec49b-ecd9-465a-b554-2cac22c7859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.669741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eec49b-ecd9-465a-b554-2cac22c7859a admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.669741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eec49b-ecd9-465a-b554-2cac22c7859a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.669741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eec49b-ecd9-465a-b554-2cac22c7859a admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.671006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eec49b-ecd9-465a-b554-2cac22c7859a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.674544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eec49b-ecd9-465a-b554-2cac22c7859a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.711332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1046/2128] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:23 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:23.711332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666155f-de3d-4406-b997-32785d6031bb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.711332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666155f-de3d-4406-b997-32785d6031bb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.711332 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666155f-de3d-4406-b997-32785d6031bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.720667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d332c-2db3-4f62-bb0d-d1822ff0cdf6 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.729826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead3a6-a28b-44b9-960b-37f2455ea406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.730171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead3a6-a28b-44b9-960b-37f2455ea406 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.731625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead3a6-a28b-44b9-960b-37f2455ea406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.732192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead3a6-a28b-44b9-960b-37f2455ea406 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.733309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead3a6-a28b-44b9-960b-37f2455ea406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.737214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead3a6-a28b-44b9-960b-37f2455ea406 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.756218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4666155f-de3d-4406-b997-32785d6031bb None None] MFA Rules not processed for user `1d57068640e94627949955d989622828`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:23.758409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4666155f-de3d-4406-b997-32785d6031bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.778134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1083/2129] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:23 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:23.781848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ee4c1-2299-42c6-9d7c-9cf0abee079c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.782998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ee4c1-2299-42c6-9d7c-9cf0abee079c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.783492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ee4c1-2299-42c6-9d7c-9cf0abee079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.819170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-545ee4c1-2299-42c6-9d7c-9cf0abee079c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:23.821239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-545ee4c1-2299-42c6-9d7c-9cf0abee079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.838477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1084/2130] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:23.840945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ee4c1-2299-42c6-9d7c-9cf0abee079c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.843288 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-545ee4c1-2299-42c6-9d7c-9cf0abee079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.865742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1047/2131] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:23.868198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666155f-de3d-4406-b997-32785d6031bb None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.868441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ee4c1-2299-42c6-9d7c-9cf0abee079c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.876325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296217e-cccb-4946-aef7-d562207068ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.876946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296217e-cccb-4946-aef7-d562207068ed admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.877347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296217e-cccb-4946-aef7-d562207068ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.877628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296217e-cccb-4946-aef7-d562207068ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.878347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296217e-cccb-4946-aef7-d562207068ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.880195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296217e-cccb-4946-aef7-d562207068ed admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.887486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666155f-de3d-4406-b997-32785d6031bb None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.893452 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1085/2132] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:23.894886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.895419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e215cd8-b148-4ed7-8594-03671a3579ef None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.895705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e215cd8-b148-4ed7-8594-03671a3579ef None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.895945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.896110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e215cd8-b148-4ed7-8594-03671a3579ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.896363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.896893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.898070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.901043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.917376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4e215cd8-b148-4ed7-8594-03671a3579ef None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:23.918943 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4e215cd8-b148-4ed7-8594-03671a3579ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.921387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1048/2133] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:23.922681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.925286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:23.935706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1086/2134] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:23.935706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e215cd8-b148-4ed7-8594-03671a3579ef None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:23.950361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e215cd8-b148-4ed7-8594-03671a3579ef None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:23.956343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda8a7-c5e5-4fd4-9f98-ded6d631c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:23.957054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda8a7-c5e5-4fd4-9f98-ded6d631c2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:23.957382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda8a7-c5e5-4fd4-9f98-ded6d631c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:23.957652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda8a7-c5e5-4fd4-9f98-ded6d631c2ed admin admin] PATH_INFO: `/v3/projects/733f7a1eaffe40db9875af1d448fd229/users/53704583a52649e88c63b50eb2cf194d/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:23.974763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda8a7-c5e5-4fd4-9f98-ded6d631c2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=733f7a1eaffe40db9875af1d448fd229, user_id=53704583a52649e88c63b50eb2cf194d, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:23.977932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda8a7-c5e5-4fd4-9f98-ded6d631c2ed admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:23.998597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1087/2135] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:23 2022] PUT /identity/v3/projects/733f7a1eaffe40db9875af1d448fd229/users/53704583a52649e88c63b50eb2cf194d/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:23.999705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda8a7-c5e5-4fd4-9f98-ded6d631c2ed admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:24.026710 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69a7b-db3f-4ffb-85e1-f4ab91c67b30 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.098329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:24.133581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.134209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda8a7-c5e5-4fd4-9f98-ded6d631c2ed admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.134883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.135486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.135944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.139737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:24.141085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da497fae-aaa7-4323-a51e-75921bae7b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.141986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497fae-aaa7-4323-a51e-75921bae7b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.142466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497fae-aaa7-4323-a51e-75921bae7b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.142765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497fae-aaa7-4323-a51e-75921bae7b7f admin admin] PATH_INFO: `/v3/projects/b424ac506c7d430a9f06b2641f758526/users/cd7ee91d5eda466186306758edeaa3fc/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.182656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:24.189225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da497fae-aaa7-4323-a51e-75921bae7b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b424ac506c7d430a9f06b2641f758526, user_id=cd7ee91d5eda466186306758edeaa3fc, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.198361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da497fae-aaa7-4323-a51e-75921bae7b7f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.228519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1088/2136] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:23 2022] PUT /identity/v3/projects/b424ac506c7d430a9f06b2641f758526/users/cd7ee91d5eda466186306758edeaa3fc/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:24.229993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da497fae-aaa7-4323-a51e-75921bae7b7f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:24.236885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.238368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.259634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1049/2137] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:24.260655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:24.280167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6bb3-cefd-4f76-82c5-f68499190105 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.376103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da497fae-aaa7-4323-a51e-75921bae7b7f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.382713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe0a23-1c75-4a62-b9f6-98cb67d6afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.383780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0a23-1c75-4a62-b9f6-98cb67d6afcf admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.384062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0a23-1c75-4a62-b9f6-98cb67d6afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.384335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0a23-1c75-4a62-b9f6-98cb67d6afcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.384993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe0a23-1c75-4a62-b9f6-98cb67d6afcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.387142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe0a23-1c75-4a62-b9f6-98cb67d6afcf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.387792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.388990 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.389781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.390564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.392243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:24.392947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.396661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.404356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1050/2138] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:24.405664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe0a23-1c75-4a62-b9f6-98cb67d6afcf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:24.424391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe0a23-1c75-4a62-b9f6-98cb67d6afcf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.428305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1089/2139] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:24.431245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cd82a-220f-4161-8057-d41567aeb3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.431875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd82a-220f-4161-8057-d41567aeb3ee admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.432345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd82a-220f-4161-8057-d41567aeb3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.432673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd82a-220f-4161-8057-d41567aeb3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.433300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cd82a-220f-4161-8057-d41567aeb3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.433635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:24.435091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cd82a-220f-4161-8057-d41567aeb3ee admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.448652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1051/2140] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:24.449383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cd82a-220f-4161-8057-d41567aeb3ee admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:24.454049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549063-7996-4c9a-9b95-9c037a510b7e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.461139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10130ae-4aae-47d9-87e0-ae208ccf7f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.461649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cd82a-220f-4161-8057-d41567aeb3ee admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.462636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10130ae-4aae-47d9-87e0-ae208ccf7f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.464087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10130ae-4aae-47d9-87e0-ae208ccf7f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.464602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10130ae-4aae-47d9-87e0-ae208ccf7f3d admin admin] PATH_INFO: `/v3/projects/733f7a1eaffe40db9875af1d448fd229/users/53704583a52649e88c63b50eb2cf194d/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.467100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10130ae-4aae-47d9-87e0-ae208ccf7f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=733f7a1eaffe40db9875af1d448fd229, user_id=53704583a52649e88c63b50eb2cf194d, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.468539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd757e-0037-4fbb-a828-026585cb1038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.470554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd757e-0037-4fbb-a828-026585cb1038 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.470852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd757e-0037-4fbb-a828-026585cb1038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.471129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd757e-0037-4fbb-a828-026585cb1038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.471796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd757e-0037-4fbb-a828-026585cb1038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.473237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10130ae-4aae-47d9-87e0-ae208ccf7f3d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.473941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd757e-0037-4fbb-a828-026585cb1038 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.489629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1090/2141] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:24 2022] PUT /identity/v3/projects/733f7a1eaffe40db9875af1d448fd229/users/53704583a52649e88c63b50eb2cf194d/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:24.490974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10130ae-4aae-47d9-87e0-ae208ccf7f3d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:24.529649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1052/2142] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:24 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:24.531650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f705f-a11b-470e-a34f-851df08810c5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.532178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f705f-a11b-470e-a34f-851df08810c5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.532631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f705f-a11b-470e-a34f-851df08810c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.580040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a00f705f-a11b-470e-a34f-851df08810c5 None None] MFA Rules not processed for user `53704583a52649e88c63b50eb2cf194d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:24.582687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a00f705f-a11b-470e-a34f-851df08810c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:24.642300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10130ae-4aae-47d9-87e0-ae208ccf7f3d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.752491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af25f8-aeaf-463d-9257-5c879e274533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.753451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af25f8-aeaf-463d-9257-5c879e274533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.753777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af25f8-aeaf-463d-9257-5c879e274533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.754098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af25f8-aeaf-463d-9257-5c879e274533 admin admin] PATH_INFO: `/v3/projects/b424ac506c7d430a9f06b2641f758526/users/cd7ee91d5eda466186306758edeaa3fc/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.757333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af25f8-aeaf-463d-9257-5c879e274533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b424ac506c7d430a9f06b2641f758526, user_id=cd7ee91d5eda466186306758edeaa3fc, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.760706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af25f8-aeaf-463d-9257-5c879e274533 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.769160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:24.779282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1091/2143] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:24 2022] PUT /identity/v3/projects/b424ac506c7d430a9f06b2641f758526/users/cd7ee91d5eda466186306758edeaa3fc/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:24.780274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af25f8-aeaf-463d-9257-5c879e274533 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:24.795881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1053/2144] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:24.796500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5441c4-fb0c-4e2d-9df0-51c957f18cd5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.796785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5441c4-fb0c-4e2d-9df0-51c957f18cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.797059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5441c4-fb0c-4e2d-9df0-51c957f18cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.833728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:24.872911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ad5441c4-fb0c-4e2d-9df0-51c957f18cd5 None None] MFA Rules not processed for user `cd7ee91d5eda466186306758edeaa3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:24.874455 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ad5441c4-fb0c-4e2d-9df0-51c957f18cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:24.894047 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af25f8-aeaf-463d-9257-5c879e274533 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:24.902689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8692e1-c43c-4943-a553-fbb8236524e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:24.904160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8692e1-c43c-4943-a553-fbb8236524e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:24.904543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8692e1-c43c-4943-a553-fbb8236524e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:24.905273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8692e1-c43c-4943-a553-fbb8236524e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:24.906103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8692e1-c43c-4943-a553-fbb8236524e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:24.910509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8692e1-c43c-4943-a553-fbb8236524e3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:24.974986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1092/2145] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:24 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:24.986124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8692e1-c43c-4943-a553-fbb8236524e3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:25.064752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1054/2146] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:25.069158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5441c4-fb0c-4e2d-9df0-51c957f18cd5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:25.082079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5441c4-fb0c-4e2d-9df0-51c957f18cd5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:25.087700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:25.088515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.088853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.089443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.090645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:25.092057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:25.104407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1055/2147] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:25.105419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:25.109249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:25.118817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8692e1-c43c-4943-a553-fbb8236524e3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:25.124143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7dbde-55fe-44d2-8c2c-1346e153183d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:25.124143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7dbde-55fe-44d2-8c2c-1346e153183d service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.124143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7dbde-55fe-44d2-8c2c-1346e153183d service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.124758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7dbde-55fe-44d2-8c2c-1346e153183d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.127546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226bb7-49b2-4c42-88ba-6947638076f7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:25.132905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d4a76-65a2-4071-942c-dede761524ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:25.133639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4a76-65a2-4071-942c-dede761524ae service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.134130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4a76-65a2-4071-942c-dede761524ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.134629 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d4a76-65a2-4071-942c-dede761524ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.152590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d4a76-65a2-4071-942c-dede761524ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:25.156125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d4a76-65a2-4071-942c-dede761524ae service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:25.176265 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1056/2148] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:25.177926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d4a76-65a2-4071-942c-dede761524ae service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:25.198927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d4a76-65a2-4071-942c-dede761524ae service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:25.210331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b0f13-ed50-4125-bac8-1feff84e49e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:25.211194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0f13-ed50-4125-bac8-1feff84e49e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.211515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0f13-ed50-4125-bac8-1feff84e49e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.211980 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0f13-ed50-4125-bac8-1feff84e49e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.213352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b0f13-ed50-4125-bac8-1feff84e49e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:25.217910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b0f13-ed50-4125-bac8-1feff84e49e7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:25.228175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7dbde-55fe-44d2-8c2c-1346e153183d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:25.230470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7dbde-55fe-44d2-8c2c-1346e153183d service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:25.251088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1057/2149] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:25.256440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b0f13-ed50-4125-bac8-1feff84e49e7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:25.260222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1093/2150] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:25.276405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b0f13-ed50-4125-bac8-1feff84e49e7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:25.305612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789613b8-d021-40a9-972b-91d060682494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:25.306779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789613b8-d021-40a9-972b-91d060682494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.307339 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789613b8-d021-40a9-972b-91d060682494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.307815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789613b8-d021-40a9-972b-91d060682494 admin admin] PATH_INFO: `/v3/projects/7ba061db128d449d95f5cd8d778b5e3f/users/4f3aa1b77be741ac902c71241cd2a959/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.355652 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789613b8-d021-40a9-972b-91d060682494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba061db128d449d95f5cd8d778b5e3f, user_id=4f3aa1b77be741ac902c71241cd2a959, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:25.359438 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789613b8-d021-40a9-972b-91d060682494 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:25.382043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7dbde-55fe-44d2-8c2c-1346e153183d service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:25.386951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1058/2151] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:25 2022] PUT /identity/v3/projects/7ba061db128d449d95f5cd8d778b5e3f/users/4f3aa1b77be741ac902c71241cd2a959/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:25.395201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0cbde-9a07-451e-847c-c44a7d5cf816 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.396388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0cbde-9a07-451e-847c-c44a7d5cf816 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.396388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0cbde-9a07-451e-847c-c44a7d5cf816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.398755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7dbde-55fe-44d2-8c2c-1346e153183d service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:25.438071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-29f0cbde-9a07-451e-847c-c44a7d5cf816 None None] MFA Rules not processed for user `4f3aa1b77be741ac902c71241cd2a959`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:25.439380 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-29f0cbde-9a07-451e-847c-c44a7d5cf816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:25.458423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:25.487679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:25.488585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.489064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.489519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.493163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:25.539959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1059/2152] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:25.572509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0cbde-9a07-451e-847c-c44a7d5cf816 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:25.591503 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:25.593381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:25.597417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0cbde-9a07-451e-847c-c44a7d5cf816 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:25.603118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcf82f-49c9-476b-b343-60d1872a58e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:25.604198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcf82f-49c9-476b-b343-60d1872a58e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.604697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcf82f-49c9-476b-b343-60d1872a58e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.605442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcf82f-49c9-476b-b343-60d1872a58e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.605562 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1094/2153] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:45:25.618810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcf82f-49c9-476b-b343-60d1872a58e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:25.620543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fcf82f-49c9-476b-b343-60d1872a58e0 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:25.631755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1060/2154] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:25.667366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:25.803330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a294b-229f-4577-aa2e-0015fdab563c service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:25.808807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:25.809716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.809879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.810140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] PATH_INFO: `/v3/users/4f3aa1b77be741ac902c71241cd2a959` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:25.811394 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3aa1b77be741ac902c71241cd2a959)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:25.813586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:25.885031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3aa1b77be741ac902c71241cd2a959'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:25.916947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3aa1b77be741ac902c71241cd2a959'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:25.918195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3aa1b77be741ac902c71241cd2a959'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:25.919697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3aa1b77be741ac902c71241cd2a959'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:25.938185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3aa1b77be741ac902c71241cd2a959'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:25.975213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1095/2155] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:25 2022] DELETE /identity/v3/users/4f3aa1b77be741ac902c71241cd2a959 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:25.982594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0596ca-029b-44f3-b5f9-557b3d4bc2bd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:25.983381 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0596ca-029b-44f3-b5f9-557b3d4bc2bd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:25.983925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0596ca-029b-44f3-b5f9-557b3d4bc2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:26.009826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-af0596ca-029b-44f3-b5f9-557b3d4bc2bd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:26.011722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-af0596ca-029b-44f3-b5f9-557b3d4bc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:26.018454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:26.137609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1061/2156] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:26.150326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:26.152786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:26.182630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:26.296376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0596ca-029b-44f3-b5f9-557b3d4bc2bd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:26.297995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-af0596ca-029b-44f3-b5f9-557b3d4bc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:26.318189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0596ca-029b-44f3-b5f9-557b3d4bc2bd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:26.335177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:26.337393 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:26.337698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:26.337974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] PATH_INFO: `/v3/users/20231d53fd4346329cfc403cf231d093` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:26.341138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20231d53fd4346329cfc403cf231d093)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:26.346859 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:26.352778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f23b4c-34d4-445b-8267-3e3aaab24981 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:26.372472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:26.373918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:26.375865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:26.376153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:26.407034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:26.409397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:26.428353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1096/2157] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:26.430023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:26.431781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:26.495717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20231d53fd4346329cfc403cf231d093'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:26.527163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20231d53fd4346329cfc403cf231d093'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:26.539235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20231d53fd4346329cfc403cf231d093'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:26.540139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20231d53fd4346329cfc403cf231d093'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:26.540926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-441371f6-9f1d-4c9b-889d-2ace903a8f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20231d53fd4346329cfc403cf231d093'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:26.553734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2dd9-ae7d-461c-998f-106f619ffb8b service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:26.559903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:26.560994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:26.561512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:26.562026 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:26.563471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1062/2158] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:26 2022] DELETE /identity/v3/users/20231d53fd4346329cfc403cf231d093 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:26.565041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:26.571574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe4c85-abc0-4826-b2e5-5d779e1e0796 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:26.572691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe4c85-abc0-4826-b2e5-5d779e1e0796 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:26.573197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe4c85-abc0-4826-b2e5-5d779e1e0796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:26.605648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-62fe4c85-abc0-4826-b2e5-5d779e1e0796 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:26.607126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-62fe4c85-abc0-4826-b2e5-5d779e1e0796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:26.687891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:26.690018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:26.713371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1097/2159] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:26.714996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1063/2160] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:26.723316 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:26.724869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:26.744549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eff77c-1b17-47c1-b2a7-063f4e9b2550 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:26.826890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fdca6-5711-4a07-87e5-8f2b4b5cc9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:26.828855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fdca6-5711-4a07-87e5-8f2b4b5cc9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:26.829244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fdca6-5711-4a07-87e5-8f2b4b5cc9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:26.830235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fdca6-5711-4a07-87e5-8f2b4b5cc9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:26.857956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fdca6-5711-4a07-87e5-8f2b4b5cc9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:26.860251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fdca6-5711-4a07-87e5-8f2b4b5cc9b9 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:26.876937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1098/2161] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:26.969721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe4c85-abc0-4826-b2e5-5d779e1e0796 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:26.972016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-62fe4c85-abc0-4826-b2e5-5d779e1e0796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:26.989894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe4c85-abc0-4826-b2e5-5d779e1e0796 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:27.003534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:27.004165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:27.004574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:27.004900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] PATH_INFO: `/v3/projects/7ba061db128d449d95f5cd8d778b5e3f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:27.010321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba061db128d449d95f5cd8d778b5e3f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:27.012795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:27.044761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:27.084597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba061db128d449d95f5cd8d778b5e3f', 'request_id': 'req-4f89ac05-d7ab-4e25-ac5a-35cde3721842'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.092891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba061db128d449d95f5cd8d778b5e3f', 'request_id': 'req-4f89ac05-d7ab-4e25-ac5a-35cde3721842'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.104076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba061db128d449d95f5cd8d778b5e3f', 'request_id': 'req-4f89ac05-d7ab-4e25-ac5a-35cde3721842'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.117918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] The token cache is being invalidate because project 7ba061db128d449d95f5cd8d778b5e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:27.117918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.119102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4f89ac05-d7ab-4e25-ac5a-35cde3721842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.121175 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1064/2162] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:26 2022] DELETE /identity/v3/projects/7ba061db128d449d95f5cd8d778b5e3f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:27.126637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afefca-6e81-491f-8d3f-7c1d568a88c8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:27.126979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afefca-6e81-491f-8d3f-7c1d568a88c8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:27.127298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afefca-6e81-491f-8d3f-7c1d568a88c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:27.150701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-59afefca-6e81-491f-8d3f-7c1d568a88c8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:27.151997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-59afefca-6e81-491f-8d3f-7c1d568a88c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:27.158280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:27.304620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1099/2163] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:27.305077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90462-5a1f-4bed-b74e-d9bdfaa092d5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:27.305430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90462-5a1f-4bed-b74e-d9bdfaa092d5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:27.305769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90462-5a1f-4bed-b74e-d9bdfaa092d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:27.348667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a4d90462-5a1f-4bed-b74e-d9bdfaa092d5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:27.352166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a4d90462-5a1f-4bed-b74e-d9bdfaa092d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:27.379360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afefca-6e81-491f-8d3f-7c1d568a88c8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:27.393341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1065/2164] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:27.397198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afefca-6e81-491f-8d3f-7c1d568a88c8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:27.404089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:27.405085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:27.405393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:27.405636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:27.406583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:27.407510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:27.417331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:27.440839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1100/2165] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:45:27.441801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90462-5a1f-4bed-b74e-d9bdfaa092d5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:27.454747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90462-5a1f-4bed-b74e-d9bdfaa092d5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:27.462766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7034f-6f8e-40c3-a10f-8be6674c90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:27.463467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7034f-6f8e-40c3-a10f-8be6674c90c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:27.464389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7034f-6f8e-40c3-a10f-8be6674c90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:27.464389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7034f-6f8e-40c3-a10f-8be6674c90c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:27.465027 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7034f-6f8e-40c3-a10f-8be6674c90c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:27.467855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7034f-6f8e-40c3-a10f-8be6674c90c8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:27.509750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:27.511721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:27.543057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1066/2166] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:27 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:27.547056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7034f-6f8e-40c3-a10f-8be6674c90c8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:27.574930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798f22-b42d-446b-b7c6-c447e4c2b8e8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:27.741884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:27.743278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:27.744072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:27.744649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] PATH_INFO: `/v3/projects/6a9667abdf6c4d569238d57bc57a18cf` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:27.748030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9667abdf6c4d569238d57bc57a18cf)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:27.750540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:27.794618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7034f-6f8e-40c3-a10f-8be6674c90c8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:27.809503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:27.810902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:27.811357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:27.811775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:27.812580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:27.814983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:27.851366 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1067/2167] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:27 2022] POST /identity/v3/users => generated 287 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:27.853359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:27.857654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:27.880021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9667abdf6c4d569238d57bc57a18cf', 'request_id': 'req-f9461170-b201-4d4f-a9e2-6da9096d1853'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.888059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9667abdf6c4d569238d57bc57a18cf', 'request_id': 'req-f9461170-b201-4d4f-a9e2-6da9096d1853'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.895226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9667abdf6c4d569238d57bc57a18cf', 'request_id': 'req-f9461170-b201-4d4f-a9e2-6da9096d1853'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.920636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] The token cache is being invalidate because project 6a9667abdf6c4d569238d57bc57a18cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:27.920926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.923500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:27.927935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1101/2168] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:27 2022] DELETE /identity/v3/projects/6a9667abdf6c4d569238d57bc57a18cf => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:27.929662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:27.932663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:27.960333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be23f3c-f540-4f5a-8bc5-c25a37446b5b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:27.991700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:28.025808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:28.034232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:28.034967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:28.035273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:28.035579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:28.038443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:28.090471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9461170-b201-4d4f-a9e2-6da9096d1853 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:28.096869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:28.097830 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:28.098147 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:28.098324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:28.099386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:28.103459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:28.117734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1102/2169] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:28.118675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:28.123866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:28.136123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:28.137617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:28.138889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3cb6-8e87-409f-93db-19dee224f227 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:28.145554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:28.146291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:28.146684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:28.147061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] PATH_INFO: `/v3/users/cd7ee91d5eda466186306758edeaa3fc` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:28.148721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7ee91d5eda466186306758edeaa3fc)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:28.150929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:28.160476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1068/2170] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:28.163386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:28.189697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f6a91-fdd3-4fc5-865c-82d3e19d1c09 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:28.204385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d218c5-8924-4f53-9ba8-695ec5d4ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:28.205145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d218c5-8924-4f53-9ba8-695ec5d4ce43 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:28.205468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d218c5-8924-4f53-9ba8-695ec5d4ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:28.205741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d218c5-8924-4f53-9ba8-695ec5d4ce43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:28.207510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d218c5-8924-4f53-9ba8-695ec5d4ce43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:28.210420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d218c5-8924-4f53-9ba8-695ec5d4ce43 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:28.240046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1069/2171] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:28.240046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d218c5-8924-4f53-9ba8-695ec5d4ce43 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:28.253021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7ee91d5eda466186306758edeaa3fc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:28.265760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d218c5-8924-4f53-9ba8-695ec5d4ce43 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:28.276611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be15aa-c1be-4556-84b6-86801a062234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:28.278984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be15aa-c1be-4556-84b6-86801a062234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:28.279659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be15aa-c1be-4556-84b6-86801a062234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:28.279935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be15aa-c1be-4556-84b6-86801a062234 admin admin] PATH_INFO: `/v3/projects/adcca246ecb946b6a5439036c30b57c7/users/1bd3778376e84a03981aec93b0dfa7cd/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:28.296205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7ee91d5eda466186306758edeaa3fc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:28.297722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7ee91d5eda466186306758edeaa3fc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:28.299050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7ee91d5eda466186306758edeaa3fc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:28.316167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7ee91d5eda466186306758edeaa3fc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:28.316491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be15aa-c1be-4556-84b6-86801a062234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcca246ecb946b6a5439036c30b57c7, user_id=1bd3778376e84a03981aec93b0dfa7cd, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:28.331261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be15aa-c1be-4556-84b6-86801a062234 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:28.336017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1070/2172] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:28 2022] PUT /identity/v3/projects/adcca246ecb946b6a5439036c30b57c7/users/1bd3778376e84a03981aec93b0dfa7cd/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:28.352621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1103/2173] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:28 2022] DELETE /identity/v3/users/cd7ee91d5eda466186306758edeaa3fc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:28.367634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38978-3dc3-4c9d-9031-f0b570a6fe08 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:28.367989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38978-3dc3-4c9d-9031-f0b570a6fe08 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:28.368475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38978-3dc3-4c9d-9031-f0b570a6fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:28.400640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-75b38978-3dc3-4c9d-9031-f0b570a6fe08 None None] MFA Rules not processed for user `1bd3778376e84a03981aec93b0dfa7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:28.402314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-75b38978-3dc3-4c9d-9031-f0b570a6fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:28.512668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1071/2174] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:28.532363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:28.534799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:28.646599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fd8cd-3a8f-461c-8851-96a48a0a5521 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:28.653524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07ce70-b917-45ff-aea9-c7b1e35db767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:28.654841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ce70-b917-45ff-aea9-c7b1e35db767 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:28.655354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ce70-b917-45ff-aea9-c7b1e35db767 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:28.655849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ce70-b917-45ff-aea9-c7b1e35db767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:28.672338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07ce70-b917-45ff-aea9-c7b1e35db767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:28.675304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07ce70-b917-45ff-aea9-c7b1e35db767 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:28.687854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1104/2175] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:28.743589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b38978-3dc3-4c9d-9031-f0b570a6fe08 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:28.745784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-75b38978-3dc3-4c9d-9031-f0b570a6fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:28.810126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:28.874241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b38978-3dc3-4c9d-9031-f0b570a6fe08 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:28.880597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:28.881119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:28.881520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:28.883319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] PATH_INFO: `/v3/projects/b424ac506c7d430a9f06b2641f758526` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:28.883319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b424ac506c7d430a9f06b2641f758526)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:28.885698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:28.965961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b424ac506c7d430a9f06b2641f758526', 'request_id': 'req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:28.977439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b424ac506c7d430a9f06b2641f758526', 'request_id': 'req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:28.989861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b424ac506c7d430a9f06b2641f758526', 'request_id': 'req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:29.008029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] The token cache is being invalidate because project b424ac506c7d430a9f06b2641f758526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:29.008630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:29.009498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-70b18ed0-f33a-4e09-a81f-ac4a0e56fea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:29.014764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1072/2176] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:28 2022] DELETE /identity/v3/projects/b424ac506c7d430a9f06b2641f758526 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:29.021045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9752e-3d34-4cda-8a55-9227c0bb6412 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.022725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9752e-3d34-4cda-8a55-9227c0bb6412 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.023155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9752e-3d34-4cda-8a55-9227c0bb6412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.054839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3db9752e-3d34-4cda-8a55-9227c0bb6412 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:29.055875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3db9752e-3d34-4cda-8a55-9227c0bb6412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:29.114019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:29.186525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1105/2177] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:29.198540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5cb17-7749-40ee-9d88-4a432f114232 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.200828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5cb17-7749-40ee-9d88-4a432f114232 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.201809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5cb17-7749-40ee-9d88-4a432f114232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.286339 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c1d5cb17-7749-40ee-9d88-4a432f114232 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:29.292636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c1d5cb17-7749-40ee-9d88-4a432f114232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:29.327632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1073/2178] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:29.333053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9752e-3d34-4cda-8a55-9227c0bb6412 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:29.347005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9752e-3d34-4cda-8a55-9227c0bb6412 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:29.360719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:29.361492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.361666 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.361940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.362627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:29.362936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:29.365485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:29.403660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1106/2179] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:29.424704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5cb17-7749-40ee-9d88-4a432f114232 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:29.453680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5cb17-7749-40ee-9d88-4a432f114232 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:29.464348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0ab7d-cc7d-44d2-9c62-af04168493a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:29.465429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0ab7d-cc7d-44d2-9c62-af04168493a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.465875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0ab7d-cc7d-44d2-9c62-af04168493a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.466336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0ab7d-cc7d-44d2-9c62-af04168493a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.467635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0ab7d-cc7d-44d2-9c62-af04168493a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:29.471999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:29.472744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0ab7d-cc7d-44d2-9c62-af04168493a6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:29.474363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:29.489463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cdd0d-2715-4d6f-849f-1f2f002159d4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:29.495277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:29.496350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.496789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.497269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] PATH_INFO: `/v3/users/e0609193d41f4a808ae0e74aae61ebe4` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.499322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0609193d41f4a808ae0e74aae61ebe4)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:29.501582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:29.541681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1074/2180] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:29 2022] POST /identity/v3/projects => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:29.549442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0ab7d-cc7d-44d2-9c62-af04168493a6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:29.599957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0609193d41f4a808ae0e74aae61ebe4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:29.626322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0609193d41f4a808ae0e74aae61ebe4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:29.627279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0609193d41f4a808ae0e74aae61ebe4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:29.628630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0609193d41f4a808ae0e74aae61ebe4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:29.642198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-298d2162-7206-4783-b792-6605229508b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0609193d41f4a808ae0e74aae61ebe4'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:29.659097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1107/2181] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:29 2022] DELETE /identity/v3/users/e0609193d41f4a808ae0e74aae61ebe4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:29.663742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543f066-4dd5-41cf-a788-c97b7dedea74 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.664102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543f066-4dd5-41cf-a788-c97b7dedea74 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.664471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543f066-4dd5-41cf-a788-c97b7dedea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.678093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0ab7d-cc7d-44d2-9c62-af04168493a6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:29.686772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8543f066-4dd5-41cf-a788-c97b7dedea74 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:29.688195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8543f066-4dd5-41cf-a788-c97b7dedea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:29.724758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:29.768698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:29.769864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.770155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.770445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.772015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:29.774851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:29.790311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1108/2182] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:29.799274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543f066-4dd5-41cf-a788-c97b7dedea74 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:29.803182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8543f066-4dd5-41cf-a788-c97b7dedea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:29.817271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1075/2183] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:29 2022] POST /identity/v3/users => generated 279 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:29.822199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:29.824054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:29.837526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e5879-3fbd-4306-9644-1b271c4816e7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:29.846617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770d6d8-b86b-4b7c-b12a-3642a248944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:29.848125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d6d8-b86b-4b7c-b12a-3642a248944e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.848664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d6d8-b86b-4b7c-b12a-3642a248944e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.849050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770d6d8-b86b-4b7c-b12a-3642a248944e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.850935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770d6d8-b86b-4b7c-b12a-3642a248944e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:29.854049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770d6d8-b86b-4b7c-b12a-3642a248944e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:29.859068 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:29.874475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1076/2184] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:45:29.878281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543f066-4dd5-41cf-a788-c97b7dedea74 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:29.878950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770d6d8-b86b-4b7c-b12a-3642a248944e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:29.884371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2038a8-e2b2-4f10-8ffc-c4a66766d692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:29.885420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2038a8-e2b2-4f10-8ffc-c4a66766d692 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.885898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2038a8-e2b2-4f10-8ffc-c4a66766d692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.886308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2038a8-e2b2-4f10-8ffc-c4a66766d692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.890207 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770d6d8-b86b-4b7c-b12a-3642a248944e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:29.894961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea975b-1831-46fd-bb21-31a3c7cc3e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:29.895579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea975b-1831-46fd-bb21-31a3c7cc3e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.896492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea975b-1831-46fd-bb21-31a3c7cc3e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.896492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea975b-1831-46fd-bb21-31a3c7cc3e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.897034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea975b-1831-46fd-bb21-31a3c7cc3e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:29.898723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2038a8-e2b2-4f10-8ffc-c4a66766d692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:29.898969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea975b-1831-46fd-bb21-31a3c7cc3e54 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:29.900176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2038a8-e2b2-4f10-8ffc-c4a66766d692 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:29.911470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1077/2185] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:29.915661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1109/2186] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:45:29.916407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea975b-1831-46fd-bb21-31a3c7cc3e54 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:29.935658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea975b-1831-46fd-bb21-31a3c7cc3e54 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:29.940954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6069f-0dbd-4363-88fc-46076de7c344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:29.941640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6069f-0dbd-4363-88fc-46076de7c344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.941918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6069f-0dbd-4363-88fc-46076de7c344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.942192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6069f-0dbd-4363-88fc-46076de7c344 admin admin] PATH_INFO: `/v3/projects/2cfd3a4581344ac5856587d5a7bfd128/users/3a2c69bebccf47dd8f116694f0437227/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:29.962121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6069f-0dbd-4363-88fc-46076de7c344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfd3a4581344ac5856587d5a7bfd128, user_id=3a2c69bebccf47dd8f116694f0437227, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:29.965296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6069f-0dbd-4363-88fc-46076de7c344 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:29.981038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1078/2187] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:29 2022] PUT /identity/v3/projects/2cfd3a4581344ac5856587d5a7bfd128/users/3a2c69bebccf47dd8f116694f0437227/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:29.993522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399996-4574-474c-bf88-5ac9f2312e52 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:29.995543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399996-4574-474c-bf88-5ac9f2312e52 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:29.996178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399996-4574-474c-bf88-5ac9f2312e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:30.031574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-67399996-4574-474c-bf88-5ac9f2312e52 None None] MFA Rules not processed for user `3a2c69bebccf47dd8f116694f0437227`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:30.032862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-67399996-4574-474c-bf88-5ac9f2312e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:30.134454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1110/2188] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:30.141948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6069f-0dbd-4363-88fc-46076de7c344 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:30.230118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6069f-0dbd-4363-88fc-46076de7c344 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:30.238322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175d357-38d4-41cd-aca7-21fabdb57852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:30.239100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175d357-38d4-41cd-aca7-21fabdb57852 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:30.239430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175d357-38d4-41cd-aca7-21fabdb57852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:30.239869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175d357-38d4-41cd-aca7-21fabdb57852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:30.241598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175d357-38d4-41cd-aca7-21fabdb57852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:30.244860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175d357-38d4-41cd-aca7-21fabdb57852 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:30.260365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67399996-4574-474c-bf88-5ac9f2312e52 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:30.262472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-67399996-4574-474c-bf88-5ac9f2312e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:30.279048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67399996-4574-474c-bf88-5ac9f2312e52 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:30.288739 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:30.289781 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:30.290223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:30.290907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] PATH_INFO: `/v3/projects/dcfcd8e87dd74fe0a49dcc3b79924b2e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:30.292993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfcd8e87dd74fe0a49dcc3b79924b2e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:30.306460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1079/2189] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:30 2022] POST /identity/v3/projects => generated 355 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:30.308125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:30.312541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175d357-38d4-41cd-aca7-21fabdb57852 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:30.377485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfcd8e87dd74fe0a49dcc3b79924b2e', 'request_id': 'req-5b80029c-a2fe-45ad-80af-96a638e96259'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.385748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfcd8e87dd74fe0a49dcc3b79924b2e', 'request_id': 'req-5b80029c-a2fe-45ad-80af-96a638e96259'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.386405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175d357-38d4-41cd-aca7-21fabdb57852 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:30.394700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfcd8e87dd74fe0a49dcc3b79924b2e', 'request_id': 'req-5b80029c-a2fe-45ad-80af-96a638e96259'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.399385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:30.419938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] The token cache is being invalidate because project dcfcd8e87dd74fe0a49dcc3b79924b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:30.420987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.422833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.427253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1111/2190] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:30 2022] DELETE /identity/v3/projects/dcfcd8e87dd74fe0a49dcc3b79924b2e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:30.432221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:30.434551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:30.536375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:30.537046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:30.537531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:30.537812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:30.538482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:30.540456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:30.555885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:30.564190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80029c-a2fe-45ad-80af-96a638e96259 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:30.589100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:30.589774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:30.590126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:30.591359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] PATH_INFO: `/v3/users/7b0b748b59dd46659fa9628408ad50f7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:30.598081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1080/2191] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:30 2022] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:30.598342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0b748b59dd46659fa9628408ad50f7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:30.598342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:30.599781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:30.604295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:30.626201 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb1f4e-176c-4371-9591-d5cb212794a5 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:30.643643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6b34a-20a4-4867-a728-78d6aab6f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:30.650716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b34a-20a4-4867-a728-78d6aab6f1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:30.650716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b34a-20a4-4867-a728-78d6aab6f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:30.650716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b34a-20a4-4867-a728-78d6aab6f1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:30.650716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6b34a-20a4-4867-a728-78d6aab6f1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:30.650716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6b34a-20a4-4867-a728-78d6aab6f1fc admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:30.690002 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1081/2192] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:30.697172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6b34a-20a4-4867-a728-78d6aab6f1fc admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:30.697980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0b748b59dd46659fa9628408ad50f7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.722006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0b748b59dd46659fa9628408ad50f7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.723074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0b748b59dd46659fa9628408ad50f7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.723907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0b748b59dd46659fa9628408ad50f7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.730113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6b34a-20a4-4867-a728-78d6aab6f1fc admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:30.741860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0b748b59dd46659fa9628408ad50f7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:30.756655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0563314-19b0-4191-b157-3161d6d56186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:30.757441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0563314-19b0-4191-b157-3161d6d56186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:30.757718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0563314-19b0-4191-b157-3161d6d56186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:30.757990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0563314-19b0-4191-b157-3161d6d56186 admin admin] PATH_INFO: `/v3/projects/2954e9b22d8a437b8fa8098f6cac25e0/users/3eb5be6e4b7543808fa3a72b17a1977e/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:30.772449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1112/2193] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:30 2022] DELETE /identity/v3/users/7b0b748b59dd46659fa9628408ad50f7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:30.794624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0563314-19b0-4191-b157-3161d6d56186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2954e9b22d8a437b8fa8098f6cac25e0, user_id=3eb5be6e4b7543808fa3a72b17a1977e, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:30.806407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0563314-19b0-4191-b157-3161d6d56186 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:30.817874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1082/2194] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:30 2022] PUT /identity/v3/projects/2954e9b22d8a437b8fa8098f6cac25e0/users/3eb5be6e4b7543808fa3a72b17a1977e/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:30.823870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:30.826565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:30.945242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961b5dd-ccc5-41d5-9724-a9374336500c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:31.133852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cdd66-6a53-4e62-985e-120d0fafe2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:31.135937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cdd66-6a53-4e62-985e-120d0fafe2ef admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:31.136465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cdd66-6a53-4e62-985e-120d0fafe2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:31.137043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cdd66-6a53-4e62-985e-120d0fafe2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:31.138156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cdd66-6a53-4e62-985e-120d0fafe2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:31.141784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cdd66-6a53-4e62-985e-120d0fafe2ef admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:31.158230 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1113/2195] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:31.165493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0563314-19b0-4191-b157-3161d6d56186 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:31.186434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0563314-19b0-4191-b157-3161d6d56186 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:31.192408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:31.193163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:31.193447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:31.193870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] PATH_INFO: `/v3/projects/2954e9b22d8a437b8fa8098f6cac25e0/users/3eb5be6e4b7543808fa3a72b17a1977e/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:31.196249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2954e9b22d8a437b8fa8098f6cac25e0, user_id=3eb5be6e4b7543808fa3a72b17a1977e, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:31.199448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:31.213226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1083/2196] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:31 2022] PUT /identity/v3/projects/2954e9b22d8a437b8fa8098f6cac25e0/users/3eb5be6e4b7543808fa3a72b17a1977e/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:31.226176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d80f4-ddde-47ee-bb27-530a8bf6d307 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:31.226461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d80f4-ddde-47ee-bb27-530a8bf6d307 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:31.226746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d80f4-ddde-47ee-bb27-530a8bf6d307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:31.297144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-475d80f4-ddde-47ee-bb27-530a8bf6d307 None None] MFA Rules not processed for user `3eb5be6e4b7543808fa3a72b17a1977e`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:31.298646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-475d80f4-ddde-47ee-bb27-530a8bf6d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:31.316212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:31.318236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:31.319738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:31.484030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1114/2197] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:31.513863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d80f4-ddde-47ee-bb27-530a8bf6d307 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:31.515398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-475d80f4-ddde-47ee-bb27-530a8bf6d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:31.531279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7230f-d56b-4bf0-bb99-e2517245ae6b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:31.537142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:31.538037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:31.538431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:31.538793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] PATH_INFO: `/v3/projects/7261108a76444427a41aab7ee38c820f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:31.540430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7261108a76444427a41aab7ee38c820f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:31.542966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:31.621001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7261108a76444427a41aab7ee38c820f', 'request_id': 'req-be68846f-8aa4-4cf7-95aa-498b938ad0c6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.622326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d80f4-ddde-47ee-bb27-530a8bf6d307 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:31.633075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7261108a76444427a41aab7ee38c820f', 'request_id': 'req-be68846f-8aa4-4cf7-95aa-498b938ad0c6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.637476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:31.660342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7261108a76444427a41aab7ee38c820f', 'request_id': 'req-be68846f-8aa4-4cf7-95aa-498b938ad0c6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.687242 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] The token cache is being invalidate because project 7261108a76444427a41aab7ee38c820f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:31.687677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.688556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.690624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1084/2198] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:31 2022] DELETE /identity/v3/projects/7261108a76444427a41aab7ee38c820f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:31.695009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:31.696562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:31.713013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:31.713906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:31.714073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:31.714365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:31.716380 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:31.768217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68846f-8aa4-4cf7-95aa-498b938ad0c6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:31.774260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:31.775009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:31.775355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:31.775696 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] PATH_INFO: `/v3/users/53704583a52649e88c63b50eb2cf194d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:31.778689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53704583a52649e88c63b50eb2cf194d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:31.780938 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:31.786210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:31.788511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:31.799927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1115/2199] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:31.857744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53704583a52649e88c63b50eb2cf194d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.896570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53704583a52649e88c63b50eb2cf194d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.913663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53704583a52649e88c63b50eb2cf194d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.915760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53704583a52649e88c63b50eb2cf194d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.916067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53704583a52649e88c63b50eb2cf194d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:31.939658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1085/2200] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:31 2022] DELETE /identity/v3/users/53704583a52649e88c63b50eb2cf194d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:31.948945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:31.950718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:31.970838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb2d9a-cc9a-453f-bc20-b6b7ba814c11 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:31.980306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:32.048025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f2d7e-bbf7-4bfe-b68f-3b6fedc8af5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:32.048657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f2d7e-bbf7-4bfe-b68f-3b6fedc8af5a service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:32.048912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f2d7e-bbf7-4bfe-b68f-3b6fedc8af5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:32.049178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f2d7e-bbf7-4bfe-b68f-3b6fedc8af5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:32.050991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ec6f2d7e-bbf7-4bfe-b68f-3b6fedc8af5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:32.127056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f2d7e-bbf7-4bfe-b68f-3b6fedc8af5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:32.128574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f2d7e-bbf7-4bfe-b68f-3b6fedc8af5a service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:32.139361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1116/2201] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:32.350202 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:32.351899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:32.446771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e063f-49f6-4646-8acd-dd1ec98f4cd2 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:32.456121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:32.457627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:32.457903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:32.458613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] PATH_INFO: `/v3/projects/733f7a1eaffe40db9875af1d448fd229` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:32.460698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733f7a1eaffe40db9875af1d448fd229)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:32.464565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:32.478690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:32.539691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733f7a1eaffe40db9875af1d448fd229', 'request_id': 'req-45623ec6-5953-4ca2-8bfe-4ea142fdf394'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.546770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733f7a1eaffe40db9875af1d448fd229', 'request_id': 'req-45623ec6-5953-4ca2-8bfe-4ea142fdf394'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.557181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733f7a1eaffe40db9875af1d448fd229', 'request_id': 'req-45623ec6-5953-4ca2-8bfe-4ea142fdf394'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.574524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] The token cache is being invalidate because project 733f7a1eaffe40db9875af1d448fd229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:32.574966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.575681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-45623ec6-5953-4ca2-8bfe-4ea142fdf394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.577373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1086/2202] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:32 2022] DELETE /identity/v3/projects/733f7a1eaffe40db9875af1d448fd229 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:32.584838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c83a8c-afbe-4e8d-9437-72ed9c06dc8d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:32.585157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c83a8c-afbe-4e8d-9437-72ed9c06dc8d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:32.585432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c83a8c-afbe-4e8d-9437-72ed9c06dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:32.607929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c0c83a8c-afbe-4e8d-9437-72ed9c06dc8d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:32.609196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c0c83a8c-afbe-4e8d-9437-72ed9c06dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:32.679538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1117/2203] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:32.688089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c2c6f-d70f-47aa-b491-57d6915565f0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:32.688373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c2c6f-d70f-47aa-b491-57d6915565f0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:32.688615 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c2c6f-d70f-47aa-b491-57d6915565f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:32.711391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-704c2c6f-d70f-47aa-b491-57d6915565f0 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:32.713326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-704c2c6f-d70f-47aa-b491-57d6915565f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:32.730228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1087/2204] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:32.736497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c83a8c-afbe-4e8d-9437-72ed9c06dc8d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:32.752856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c83a8c-afbe-4e8d-9437-72ed9c06dc8d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:32.753334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c2c6f-d70f-47aa-b491-57d6915565f0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:32.755572 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-704c2c6f-d70f-47aa-b491-57d6915565f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:32.758296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:32.759272 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:32.759552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:32.759817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:32.760465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:32.760760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:32.762345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:32.771597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c2c6f-d70f-47aa-b491-57d6915565f0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:32.775835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1118/2205] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:32.776724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:32.782181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:32.783064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:32.784245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:32.784510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:32.784875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] PATH_INFO: `/v3/users/79de373295a34fd29057a5ada98f4100` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:32.787302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79de373295a34fd29057a5ada98f4100)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:32.789290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:32.796368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf6cc7-5d91-4e11-b3bf-a87b69dcd835 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:32.802311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:32.803560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:32.803836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:32.805071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] PATH_INFO: `/v3/users/1bd3778376e84a03981aec93b0dfa7cd` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:32.807250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd3778376e84a03981aec93b0dfa7cd)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:32.810139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:32.861611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79de373295a34fd29057a5ada98f4100'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.880709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:32.882089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd3778376e84a03981aec93b0dfa7cd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.888164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79de373295a34fd29057a5ada98f4100'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.906226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd3778376e84a03981aec93b0dfa7cd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.907538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd3778376e84a03981aec93b0dfa7cd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.908408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd3778376e84a03981aec93b0dfa7cd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.909146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79de373295a34fd29057a5ada98f4100'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.910098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79de373295a34fd29057a5ada98f4100'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.911286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79de373295a34fd29057a5ada98f4100'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.922685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85e8792e-ad73-4a11-821d-1bf6ef6fe9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd3778376e84a03981aec93b0dfa7cd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:32.937064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1088/2206] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:32 2022] DELETE /identity/v3/users/79de373295a34fd29057a5ada98f4100 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:32.941941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:32.943647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:32.949695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1119/2207] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:32 2022] DELETE /identity/v3/users/1bd3778376e84a03981aec93b0dfa7cd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:32.952136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1859264-6257-4d9d-8444-c53b09be53a3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:32.952644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1859264-6257-4d9d-8444-c53b09be53a3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:32.953102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1859264-6257-4d9d-8444-c53b09be53a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:32.979441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f1859264-6257-4d9d-8444-c53b09be53a3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:32.980686 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f1859264-6257-4d9d-8444-c53b09be53a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:33.013836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056276ab-51f3-4d94-99cc-09f04d5f4d42 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:33.017750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:33.050213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1120/2208] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:33.052273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec088-2766-432c-8fb8-77b95fe0e8f6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.052273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec088-2766-432c-8fb8-77b95fe0e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.052791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfec088-2766-432c-8fb8-77b95fe0e8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.077906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-cbfec088-2766-432c-8fb8-77b95fe0e8f6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:33.079159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cbfec088-2766-432c-8fb8-77b95fe0e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:33.090788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1121/2209] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:33.091368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfec088-2766-432c-8fb8-77b95fe0e8f6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:33.095801 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cbfec088-2766-432c-8fb8-77b95fe0e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:33.098323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:33.100070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.100070 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.100766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.101560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:33.103722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:33.147967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1089/2210] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:32 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:33.149703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:33.152485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:33.180225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfec088-2766-432c-8fb8-77b95fe0e8f6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:33.243690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03064673-e306-4b0e-8b03-14f370f76008 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:33.249083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ad051-8635-4153-a86a-398857658ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:33.250419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad051-8635-4153-a86a-398857658ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.250419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad051-8635-4153-a86a-398857658ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.250419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ad051-8635-4153-a86a-398857658ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.253799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75ec88-15b5-4175-9115-840cb3cb6e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:33.260884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75ec88-15b5-4175-9115-840cb3cb6e41 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.261672 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75ec88-15b5-4175-9115-840cb3cb6e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.262367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75ec88-15b5-4175-9115-840cb3cb6e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.335264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:33.346800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ad051-8635-4153-a86a-398857658ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:33.349639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ad051-8635-4153-a86a-398857658ad2 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:33.370226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1090/2211] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:33.371394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ad051-8635-4153-a86a-398857658ad2 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:33.389385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ad051-8635-4153-a86a-398857658ad2 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:33.403946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc043e-e58d-489c-bfe2-02ec41ae1034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:33.405080 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc043e-e58d-489c-bfe2-02ec41ae1034 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.405517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc043e-e58d-489c-bfe2-02ec41ae1034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.405991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc043e-e58d-489c-bfe2-02ec41ae1034 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.408878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc043e-e58d-489c-bfe2-02ec41ae1034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:33.412998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc043e-e58d-489c-bfe2-02ec41ae1034 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:33.445907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75ec88-15b5-4175-9115-840cb3cb6e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:33.448675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75ec88-15b5-4175-9115-840cb3cb6e41 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:33.459625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1091/2212] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:33 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:33.462870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1122/2213] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:33.465940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc043e-e58d-489c-bfe2-02ec41ae1034 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:33.480747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc043e-e58d-489c-bfe2-02ec41ae1034 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:33.486974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d62cd-15a6-4f55-be2f-0b1e94f8fdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:33.487816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d62cd-15a6-4f55-be2f-0b1e94f8fdde admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.488038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d62cd-15a6-4f55-be2f-0b1e94f8fdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.488316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d62cd-15a6-4f55-be2f-0b1e94f8fdde admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.489130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d62cd-15a6-4f55-be2f-0b1e94f8fdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:33.491385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d62cd-15a6-4f55-be2f-0b1e94f8fdde admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:33.510240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1092/2214] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:33.512143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75ec88-15b5-4175-9115-840cb3cb6e41 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:33.530085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75ec88-15b5-4175-9115-840cb3cb6e41 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:33.536246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a0e97-10f2-40f4-9af7-95762fb025ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:33.537018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a0e97-10f2-40f4-9af7-95762fb025ba admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.537389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a0e97-10f2-40f4-9af7-95762fb025ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.537749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a0e97-10f2-40f4-9af7-95762fb025ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.538536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a0e97-10f2-40f4-9af7-95762fb025ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:33.540659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a0e97-10f2-40f4-9af7-95762fb025ba admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:33.570993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d62cd-15a6-4f55-be2f-0b1e94f8fdde admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:33.587903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1123/2215] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:33.591086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d62cd-15a6-4f55-be2f-0b1e94f8fdde admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:33.597828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadfd76-a866-4ba8-a6f6-424b96356e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:33.598166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadfd76-a866-4ba8-a6f6-424b96356e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.598486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadfd76-a866-4ba8-a6f6-424b96356e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.598760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadfd76-a866-4ba8-a6f6-424b96356e0d admin admin] PATH_INFO: `/v3/projects/0a2837ef5136442d8307e3c9722df400/users/887c82a17fc849f498242e2864d31f64/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.618352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:33.625990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadfd76-a866-4ba8-a6f6-424b96356e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2837ef5136442d8307e3c9722df400, user_id=887c82a17fc849f498242e2864d31f64, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:33.629985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadfd76-a866-4ba8-a6f6-424b96356e0d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:33.669083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1093/2216] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:33 2022] PUT /identity/v3/projects/0a2837ef5136442d8307e3c9722df400/users/887c82a17fc849f498242e2864d31f64/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:33.685468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e48a7-765d-4a50-9b0d-3a61adf0d867 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:33.685772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e48a7-765d-4a50-9b0d-3a61adf0d867 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:33.686154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e48a7-765d-4a50-9b0d-3a61adf0d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:33.741074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e71e48a7-765d-4a50-9b0d-3a61adf0d867 None None] MFA Rules not processed for user `887c82a17fc849f498242e2864d31f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:33.744399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e71e48a7-765d-4a50-9b0d-3a61adf0d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:33.891828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1124/2217] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:33.897585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadfd76-a866-4ba8-a6f6-424b96356e0d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:33.969342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e48a7-765d-4a50-9b0d-3a61adf0d867 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:33.972637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e71e48a7-765d-4a50-9b0d-3a61adf0d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:34.043086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadfd76-a866-4ba8-a6f6-424b96356e0d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:34.051326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c5cf-da96-48c5-8e9a-cf2bce7f1f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:34.054979 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c5cf-da96-48c5-8e9a-cf2bce7f1f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.055909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c5cf-da96-48c5-8e9a-cf2bce7f1f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.056644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c5cf-da96-48c5-8e9a-cf2bce7f1f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.058368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c5cf-da96-48c5-8e9a-cf2bce7f1f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:34.062172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c5cf-da96-48c5-8e9a-cf2bce7f1f55 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:34.106482 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e48a7-765d-4a50-9b0d-3a61adf0d867 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:34.112088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:34.113878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.114357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.114744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] PATH_INFO: `/v3/projects/adcca246ecb946b6a5439036c30b57c7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.116698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcca246ecb946b6a5439036c30b57c7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:34.119810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:34.120977 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1094/2218] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:33 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:34.127720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c5cf-da96-48c5-8e9a-cf2bce7f1f55 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:34.226866 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:34.237230 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcca246ecb946b6a5439036c30b57c7', 'request_id': 'req-85a643c4-ebf5-4542-857e-b0194f4ddb50'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.246481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcca246ecb946b6a5439036c30b57c7', 'request_id': 'req-85a643c4-ebf5-4542-857e-b0194f4ddb50'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.259140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcca246ecb946b6a5439036c30b57c7', 'request_id': 'req-85a643c4-ebf5-4542-857e-b0194f4ddb50'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.277186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] The token cache is being invalidate because project adcca246ecb946b6a5439036c30b57c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:34.277977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.278634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.295618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1125/2219] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:33 2022] DELETE /identity/v3/projects/adcca246ecb946b6a5439036c30b57c7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:34.299305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c5cf-da96-48c5-8e9a-cf2bce7f1f55 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:34.299408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:34.299408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:34.395948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a643c4-ebf5-4542-857e-b0194f4ddb50 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:34.402483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:34.403346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.403722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.404326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] PATH_INFO: `/v3/projects/060ae45805cf43899affa4cdf38fdd90` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.406305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060ae45805cf43899affa4cdf38fdd90)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:34.407024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634079e-f4ea-41e3-8f6f-06771e87de05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:34.408729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634079e-f4ea-41e3-8f6f-06771e87de05 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.409012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:34.409588 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634079e-f4ea-41e3-8f6f-06771e87de05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.410034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634079e-f4ea-41e3-8f6f-06771e87de05 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.411168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634079e-f4ea-41e3-8f6f-06771e87de05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:34.413778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634079e-f4ea-41e3-8f6f-06771e87de05 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:34.458016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1095/2220] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:34 2022] POST /identity/v3/users => generated 299 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:34.460869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762b758-23d9-45a8-82f2-b2faa095c75e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.461155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762b758-23d9-45a8-82f2-b2faa095c75e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.461427 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762b758-23d9-45a8-82f2-b2faa095c75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.485860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060ae45805cf43899affa4cdf38fdd90', 'request_id': 'req-774def8c-b17d-462b-a18e-198c2c695989'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.490276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3762b758-23d9-45a8-82f2-b2faa095c75e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:34.493238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060ae45805cf43899affa4cdf38fdd90', 'request_id': 'req-774def8c-b17d-462b-a18e-198c2c695989'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.493489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3762b758-23d9-45a8-82f2-b2faa095c75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:34.504098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060ae45805cf43899affa4cdf38fdd90', 'request_id': 'req-774def8c-b17d-462b-a18e-198c2c695989'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.510767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:34.527786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] The token cache is being invalidate because project 060ae45805cf43899affa4cdf38fdd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:34.528075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.529916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.531884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1126/2221] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:34 2022] DELETE /identity/v3/projects/060ae45805cf43899affa4cdf38fdd90 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:34.532714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:34.534408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:34.637471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774def8c-b17d-462b-a18e-198c2c695989 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:34.645066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:34.645712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.645991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.646333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.647250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:34.649398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:34.656366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:34.670797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1127/2222] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:34.673078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1096/2223] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:34.673425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:34.675156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762b758-23d9-45a8-82f2-b2faa095c75e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:34.676204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:34.690059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762b758-23d9-45a8-82f2-b2faa095c75e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:34.698242 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61bd9a-422a-4691-b2ec-3fb2d2b34699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:34.699141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61bd9a-422a-4691-b2ec-3fb2d2b34699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.699486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61bd9a-422a-4691-b2ec-3fb2d2b34699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.699829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61bd9a-422a-4691-b2ec-3fb2d2b34699 admin admin] PATH_INFO: `/v3/projects/aac90e3c6d084b5d94b86623d34cee8b/users/f14414a891cf4ed2a565d245ef456af9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.713048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2f502-1eb0-4c73-90ed-26313fe76b3e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:34.723652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:34.726343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.730900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.731173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] PATH_INFO: `/v3/users/095d9a27024f4e77ae842da09e6eba37` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.733482 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095d9a27024f4e77ae842da09e6eba37)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:34.735723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:34.739672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61bd9a-422a-4691-b2ec-3fb2d2b34699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac90e3c6d084b5d94b86623d34cee8b, user_id=f14414a891cf4ed2a565d245ef456af9, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:34.742637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61bd9a-422a-4691-b2ec-3fb2d2b34699 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:34.768536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1097/2224] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:34 2022] PUT /identity/v3/projects/aac90e3c6d084b5d94b86623d34cee8b/users/f14414a891cf4ed2a565d245ef456af9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:34.770082 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b96c1-19bc-4a0a-ac8e-c67d67b2171e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.770367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b96c1-19bc-4a0a-ac8e-c67d67b2171e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.770660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b96c1-19bc-4a0a-ac8e-c67d67b2171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.796263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-5a9b96c1-19bc-4a0a-ac8e-c67d67b2171e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:34.798871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-5a9b96c1-19bc-4a0a-ac8e-c67d67b2171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:34.849543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095d9a27024f4e77ae842da09e6eba37'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.881782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095d9a27024f4e77ae842da09e6eba37'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.882892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095d9a27024f4e77ae842da09e6eba37'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.884188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095d9a27024f4e77ae842da09e6eba37'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.885664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1098/2225] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:34.886679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b96c1-19bc-4a0a-ac8e-c67d67b2171e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:34.898745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095d9a27024f4e77ae842da09e6eba37'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:34.903548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b96c1-19bc-4a0a-ac8e-c67d67b2171e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:34.909029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:34.909657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:34.909932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:34.910199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:34.911059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:34.912742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:34.924470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1128/2226] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:34 2022] DELETE /identity/v3/users/095d9a27024f4e77ae842da09e6eba37 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:34.925488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:34.935596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1099/2227] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:34.937147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:34.939298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:34.948929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:34.958554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb178b2-e6cb-418d-ad4f-c174e8c6b71b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.061248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f794f4-5cc8-4dac-bff3-3e7b64aafa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.062074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f794f4-5cc8-4dac-bff3-3e7b64aafa39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.062799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f794f4-5cc8-4dac-bff3-3e7b64aafa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.063142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f794f4-5cc8-4dac-bff3-3e7b64aafa39 admin admin] PATH_INFO: `/v3/projects/aac90e3c6d084b5d94b86623d34cee8b/users/f14414a891cf4ed2a565d245ef456af9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.066795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f794f4-5cc8-4dac-bff3-3e7b64aafa39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac90e3c6d084b5d94b86623d34cee8b, user_id=f14414a891cf4ed2a565d245ef456af9, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.071302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f794f4-5cc8-4dac-bff3-3e7b64aafa39 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.074085 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ab36-e218-4624-953d-fb19cb470118 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.090969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1100/2228] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:34 2022] PUT /identity/v3/projects/aac90e3c6d084b5d94b86623d34cee8b/users/f14414a891cf4ed2a565d245ef456af9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:35.091884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.092527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.092954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.093248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.094096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:35.094425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.096051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.109228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703789-b3aa-4649-a5fe-62ba3581a018 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.109633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703789-b3aa-4649-a5fe-62ba3581a018 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.110100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703789-b3aa-4649-a5fe-62ba3581a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.116661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1129/2229] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:35.121982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:35.137933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff7625-3550-495d-802a-0cea2da11021 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.149882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:35.172981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9e703789-b3aa-4649-a5fe-62ba3581a018 None None] MFA Rules not processed for user `f14414a891cf4ed2a565d245ef456af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:35.175318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9e703789-b3aa-4649-a5fe-62ba3581a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:35.223984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1720ae6-3b90-42d6-9682-36bdde8f887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.225049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1720ae6-3b90-42d6-9682-36bdde8f887a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.225473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1720ae6-3b90-42d6-9682-36bdde8f887a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.225887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1720ae6-3b90-42d6-9682-36bdde8f887a admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.227330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1720ae6-3b90-42d6-9682-36bdde8f887a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.229798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1720ae6-3b90-42d6-9682-36bdde8f887a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.285904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:35.327450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1130/2230] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:35 2022] POST /identity/v3/projects => generated 397 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:35.333917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1720ae6-3b90-42d6-9682-36bdde8f887a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:35.446533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1720ae6-3b90-42d6-9682-36bdde8f887a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.457009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a720809-da79-4e8a-8502-fcd437d79962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.458057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a720809-da79-4e8a-8502-fcd437d79962 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.458807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a720809-da79-4e8a-8502-fcd437d79962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.459361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a720809-da79-4e8a-8502-fcd437d79962 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.460359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a720809-da79-4e8a-8502-fcd437d79962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.463806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1101/2231] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:35.469438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a720809-da79-4e8a-8502-fcd437d79962 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.482424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e703789-b3aa-4649-a5fe-62ba3581a018 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:35.486975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9e703789-b3aa-4649-a5fe-62ba3581a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:35.502745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1131/2232] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:35 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:35.507374 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a720809-da79-4e8a-8502-fcd437d79962 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:35.538296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a720809-da79-4e8a-8502-fcd437d79962 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.545433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c476fe-7395-454e-a4a8-e417929619d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.546418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c476fe-7395-454e-a4a8-e417929619d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.546755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c476fe-7395-454e-a4a8-e417929619d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.547072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c476fe-7395-454e-a4a8-e417929619d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.547835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c476fe-7395-454e-a4a8-e417929619d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.549475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c476fe-7395-454e-a4a8-e417929619d7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.569518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1132/2233] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:35.571134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c476fe-7395-454e-a4a8-e417929619d7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:35.584336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c476fe-7395-454e-a4a8-e417929619d7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.589437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e703789-b3aa-4649-a5fe-62ba3581a018 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.591671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaba0d-9e9c-4877-891e-3a1459c0c092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.592318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaba0d-9e9c-4877-891e-3a1459c0c092 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.592581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaba0d-9e9c-4877-891e-3a1459c0c092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.592851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaba0d-9e9c-4877-891e-3a1459c0c092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.593500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaba0d-9e9c-4877-891e-3a1459c0c092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.595539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceaba0d-9e9c-4877-891e-3a1459c0c092 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.615215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1133/2234] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:35.616942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaba0d-9e9c-4877-891e-3a1459c0c092 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:35.629971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaba0d-9e9c-4877-891e-3a1459c0c092 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.636913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.636913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.636913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.637481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] PATH_INFO: `/v3/projects/a25bf15b480c4f7eba9b62365b59d433/users/ae826c49910946ffac918aad78c493d5/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.668601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25bf15b480c4f7eba9b62365b59d433, user_id=ae826c49910946ffac918aad78c493d5, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.674240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.684737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae543d-1692-4df8-a1b4-86318ae889d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.685782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae543d-1692-4df8-a1b4-86318ae889d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.686261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae543d-1692-4df8-a1b4-86318ae889d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.686787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae543d-1692-4df8-a1b4-86318ae889d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.689964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d3ae543d-1692-4df8-a1b4-86318ae889d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:35.714689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1134/2235] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:35 2022] PUT /identity/v3/projects/a25bf15b480c4f7eba9b62365b59d433/users/ae826c49910946ffac918aad78c493d5/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:35.714689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:35.722417 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:35.825083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae543d-1692-4df8-a1b4-86318ae889d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.828775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae543d-1692-4df8-a1b4-86318ae889d0 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.842869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd16c-a43a-4d15-89b9-e6c9d44b704b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:35.852457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:35.853912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.854403 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.854698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] PATH_INFO: `/v3/projects/0e8c7623a9294cab9aed653b783cf8d6` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.856087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8c7623a9294cab9aed653b783cf8d6)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:35.858024 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:35.858410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1102/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:35.866003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338ef55-05db-48af-87d7-66eb5fd3ab1d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:35.866728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338ef55-05db-48af-87d7-66eb5fd3ab1d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:35.867308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338ef55-05db-48af-87d7-66eb5fd3ab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:35.907754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:35.922185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:35.928494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8c7623a9294cab9aed653b783cf8d6', 'request_id': 'req-50c3ddf2-e448-4598-bbd5-4a0d01e772df'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:35.948067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8c7623a9294cab9aed653b783cf8d6', 'request_id': 'req-50c3ddf2-e448-4598-bbd5-4a0d01e772df'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:35.955802 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-d338ef55-05db-48af-87d7-66eb5fd3ab1d None None] MFA Rules not processed for user `ae826c49910946ffac918aad78c493d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:35.957779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d338ef55-05db-48af-87d7-66eb5fd3ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:35.970223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8c7623a9294cab9aed653b783cf8d6', 'request_id': 'req-50c3ddf2-e448-4598-bbd5-4a0d01e772df'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:36.014153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] The token cache is being invalidate because project 0e8c7623a9294cab9aed653b783cf8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:36.014496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:36.015205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:36.017088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1135/2237] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:35 2022] DELETE /identity/v3/projects/0e8c7623a9294cab9aed653b783cf8d6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:36.023310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:36.025712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:36.107493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1103/2238] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:36.128631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338ef55-05db-48af-87d7-66eb5fd3ab1d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:36.131409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d338ef55-05db-48af-87d7-66eb5fd3ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:36.168471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3ddf2-e448-4598-bbd5-4a0d01e772df admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:36.184977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:36.185657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:36.186656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:36.186656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] PATH_INFO: `/v3/users/1d57068640e94627949955d989622828` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:36.187825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d57068640e94627949955d989622828)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:36.189843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:36.250692 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338ef55-05db-48af-87d7-66eb5fd3ab1d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:36.255245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0476dd-1210-4654-a00b-f60f1d1fbf50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:36.256274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0476dd-1210-4654-a00b-f60f1d1fbf50 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:36.256481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0476dd-1210-4654-a00b-f60f1d1fbf50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:36.256761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0476dd-1210-4654-a00b-f60f1d1fbf50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:36.266671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d57068640e94627949955d989622828'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:36.268329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0476dd-1210-4654-a00b-f60f1d1fbf50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:36.269972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0476dd-1210-4654-a00b-f60f1d1fbf50 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:36.281892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1104/2239] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:36.288384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d57068640e94627949955d989622828'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:36.289668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d57068640e94627949955d989622828'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:36.290826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d57068640e94627949955d989622828'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:36.305714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3bfbce96-fbfa-47c4-9be1-2c30dc1c8b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d57068640e94627949955d989622828'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:36.323883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1136/2240] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:36 2022] DELETE /identity/v3/users/1d57068640e94627949955d989622828 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:36.793165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0476dd-1210-4654-a00b-f60f1d1fbf50 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:36.842499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0476dd-1210-4654-a00b-f60f1d1fbf50 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:37.008852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:37.010182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.010592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.011074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] PATH_INFO: `/v3/projects/f1edc16781ce448d8a862efaed7c9b86` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.012433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1edc16781ce448d8a862efaed7c9b86)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:37.015749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:37.100266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:37.112055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1edc16781ce448d8a862efaed7c9b86', 'request_id': 'req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:37.126879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1edc16781ce448d8a862efaed7c9b86', 'request_id': 'req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:37.142949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1edc16781ce448d8a862efaed7c9b86', 'request_id': 'req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:37.162110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] The token cache is being invalidate because project f1edc16781ce448d8a862efaed7c9b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:37.162308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:37.163062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ccf1f3a4-4ed9-4efd-a4cd-5544ae9d4f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:37.166297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1105/2241] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:36 2022] DELETE /identity/v3/projects/f1edc16781ce448d8a862efaed7c9b86 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:37.173489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4f48-ff81-481c-904f-e4b0912405aa None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.174139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4f48-ff81-481c-904f-e4b0912405aa None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.174139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d4f48-ff81-481c-904f-e4b0912405aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.209653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3e6d4f48-ff81-481c-904f-e4b0912405aa None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:37.221168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3e6d4f48-ff81-481c-904f-e4b0912405aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:37.307784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:37.358533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1137/2242] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:37.361751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707986c-1537-4e3b-ae15-99ad7135a8ec None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.362022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707986c-1537-4e3b-ae15-99ad7135a8ec None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.362351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707986c-1537-4e3b-ae15-99ad7135a8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.385696 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7707986c-1537-4e3b-ae15-99ad7135a8ec None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:37.387221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7707986c-1537-4e3b-ae15-99ad7135a8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:37.398435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1106/2243] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:37.402361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d4f48-ff81-481c-904f-e4b0912405aa None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:37.414776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d4f48-ff81-481c-904f-e4b0912405aa None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:37.422060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:37.423053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.423358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.423851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.424605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:37.425389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:37.426958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:37.445622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1138/2244] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:45:37.451127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707986c-1537-4e3b-ae15-99ad7135a8ec None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:37.465140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707986c-1537-4e3b-ae15-99ad7135a8ec None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:37.470978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41134d-dcf1-42e3-ae9d-a349f981b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:37.471773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41134d-dcf1-42e3-ae9d-a349f981b86c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.472321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41134d-dcf1-42e3-ae9d-a349f981b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.472672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41134d-dcf1-42e3-ae9d-a349f981b86c admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.473433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41134d-dcf1-42e3-ae9d-a349f981b86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:37.476020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41134d-dcf1-42e3-ae9d-a349f981b86c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:37.520573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1107/2245] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:37 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:37.529372 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:37.546577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf3a5a-7fd9-4084-9808-afaa419af24b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:37.684789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8f08e-dbbc-481e-84f3-7a5cc861803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:37.685233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f08e-dbbc-481e-84f3-7a5cc861803d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.685970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f08e-dbbc-481e-84f3-7a5cc861803d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.686783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f08e-dbbc-481e-84f3-7a5cc861803d admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.687500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8f08e-dbbc-481e-84f3-7a5cc861803d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:37.692328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8f08e-dbbc-481e-84f3-7a5cc861803d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:37.747552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1139/2246] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:37 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:37.751575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41134d-dcf1-42e3-ae9d-a349f981b86c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:37.775922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41134d-dcf1-42e3-ae9d-a349f981b86c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:37.785069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a9bee-e137-4591-8cd3-18c5ac8aefd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:37.786010 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9bee-e137-4591-8cd3-18c5ac8aefd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.786415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9bee-e137-4591-8cd3-18c5ac8aefd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.786912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9bee-e137-4591-8cd3-18c5ac8aefd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.788286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a9bee-e137-4591-8cd3-18c5ac8aefd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:37.790982 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a9bee-e137-4591-8cd3-18c5ac8aefd6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:37.808447 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1108/2247] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:45:37.810693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8f08e-dbbc-481e-84f3-7a5cc861803d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:37.835657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8f08e-dbbc-481e-84f3-7a5cc861803d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:37.850273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a12d-63ca-441a-bfdb-f1825ad06f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:37.851327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a12d-63ca-441a-bfdb-f1825ad06f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.852021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a12d-63ca-441a-bfdb-f1825ad06f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.852450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a12d-63ca-441a-bfdb-f1825ad06f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.854109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a12d-63ca-441a-bfdb-f1825ad06f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:37.856829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a12d-63ca-441a-bfdb-f1825ad06f9b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:37.886897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1140/2248] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:37.888416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a9bee-e137-4591-8cd3-18c5ac8aefd6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:37.900850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a9bee-e137-4591-8cd3-18c5ac8aefd6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:37.907540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:37.908748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.909030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.909305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] PATH_INFO: `/v3/projects/b766c13c514e4a2d93ba43be8c28b9a8/users/ea2c8da18b5e4e409667afc09dce09dd/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:37.929737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b766c13c514e4a2d93ba43be8c28b9a8, user_id=ea2c8da18b5e4e409667afc09dce09dd, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:37.935634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:37.954005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1109/2249] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:37 2022] PUT /identity/v3/projects/b766c13c514e4a2d93ba43be8c28b9a8/users/ea2c8da18b5e4e409667afc09dce09dd/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:37.964564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c602-15e0-4bcb-a75f-2fef09a1d541 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:37.964838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c602-15e0-4bcb-a75f-2fef09a1d541 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:37.965097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132c602-15e0-4bcb-a75f-2fef09a1d541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:38.004424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c132c602-15e0-4bcb-a75f-2fef09a1d541 None None] MFA Rules not processed for user `ea2c8da18b5e4e409667afc09dce09dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:38.007914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c132c602-15e0-4bcb-a75f-2fef09a1d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:38.156782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1141/2250] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:38.170361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:38.172231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:38.335400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453cd28-7774-4dc4-a1b6-47fd9041d068 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:38.339634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89357dc69c8f456580613061f2cbef07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:38.340304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:38.340589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:38.342299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:38.363046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:38.365340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:38.382329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1110/2251] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:39.829613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132c602-15e0-4bcb-a75f-2fef09a1d541 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:39.831690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c132c602-15e0-4bcb-a75f-2fef09a1d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:39.882695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:39.907041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132c602-15e0-4bcb-a75f-2fef09a1d541 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:39.912665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:39.914460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:39.914460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:39.914460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:39.916517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:40.014298 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:40.022444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:40.035080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1142/2252] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:40.777414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:40.777414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:40.785713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0362c4-7942-4894-82cf-270d24f2814b service glance] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:40.790286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1b0a3-77f4-4cb4-a37c-ff33848d7a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:40.791177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1b0a3-77f4-4cb4-a37c-ff33848d7a40 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:40.791448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1b0a3-77f4-4cb4-a37c-ff33848d7a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:40.792050 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1b0a3-77f4-4cb4-a37c-ff33848d7a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:40.794879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-d0c1b0a3-77f4-4cb4-a37c-ff33848d7a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:40.889225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:40.925839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1b0a3-77f4-4cb4-a37c-ff33848d7a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:40.928259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1b0a3-77f4-4cb4-a37c-ff33848d7a40 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:40.950631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1111/2253] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:42.020035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:42.023334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:42.104599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10acd3a-1a00-4a29-98d6-c5dceaf35ccd service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:42.110235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:42.110924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:42.111200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:42.111471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] PATH_INFO: `/v3/users/ae826c49910946ffac918aad78c493d5` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:42.112664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae826c49910946ffac918aad78c493d5)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:42.114657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:42.170076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae826c49910946ffac918aad78c493d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:42.187284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae826c49910946ffac918aad78c493d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:42.188099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae826c49910946ffac918aad78c493d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:42.188749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae826c49910946ffac918aad78c493d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:42.200207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae826c49910946ffac918aad78c493d5'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:42.216263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1143/2254] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:42 2022] DELETE /identity/v3/users/ae826c49910946ffac918aad78c493d5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:42.221182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16f48-d620-456d-8397-891b3ec07c3d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:42.221949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16f48-d620-456d-8397-891b3ec07c3d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:42.222093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16f48-d620-456d-8397-891b3ec07c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:42.249824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-43d16f48-d620-456d-8397-891b3ec07c3d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:42.251111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-43d16f48-d620-456d-8397-891b3ec07c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:42.345167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1112/2255] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:42.356240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:42.357689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:42.368582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:42.441198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873968f-a511-46b3-809c-f4752aefbe10 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:42.446315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:42.446972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:42.447251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:42.447521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:42.461468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:42.464695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:42.478609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1144/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:42.864730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16f48-d620-456d-8397-891b3ec07c3d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:42.866672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-43d16f48-d620-456d-8397-891b3ec07c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:42.888512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16f48-d620-456d-8397-891b3ec07c3d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:42.898847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:42.899632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:42.900091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:42.901988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] PATH_INFO: `/v3/projects/a25bf15b480c4f7eba9b62365b59d433` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:42.901988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25bf15b480c4f7eba9b62365b59d433)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:42.905843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:42.980187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25bf15b480c4f7eba9b62365b59d433', 'request_id': 'req-dbc8b181-d627-4841-8e25-84c4a2670741'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:42.988481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25bf15b480c4f7eba9b62365b59d433', 'request_id': 'req-dbc8b181-d627-4841-8e25-84c4a2670741'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:42.999853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25bf15b480c4f7eba9b62365b59d433', 'request_id': 'req-dbc8b181-d627-4841-8e25-84c4a2670741'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:43.044732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] The token cache is being invalidate because project a25bf15b480c4f7eba9b62365b59d433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:43.045106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:43.045680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbc8b181-d627-4841-8e25-84c4a2670741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:43.047578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1113/2257] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:42 2022] DELETE /identity/v3/projects/a25bf15b480c4f7eba9b62365b59d433 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:46.070232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:46.077329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:46.091468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec07b0-24a7-46b7-aae7-e20e2c524fb0 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:46.149129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:46.149769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:46.150052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:46.150364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] PATH_INFO: `/v3/users/887c82a17fc849f498242e2864d31f64` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:46.151495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=887c82a17fc849f498242e2864d31f64)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:46.153470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:46.225971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887c82a17fc849f498242e2864d31f64'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:46.240513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887c82a17fc849f498242e2864d31f64'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:46.241415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887c82a17fc849f498242e2864d31f64'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:46.242034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887c82a17fc849f498242e2864d31f64'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:46.250570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887c82a17fc849f498242e2864d31f64'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:46.267215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1145/2258] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:46 2022] DELETE /identity/v3/users/887c82a17fc849f498242e2864d31f64 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:46.276199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51cab-a4e4-4fc7-a291-c3c72e97ea6d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:46.276758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51cab-a4e4-4fc7-a291-c3c72e97ea6d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:46.276758 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51cab-a4e4-4fc7-a291-c3c72e97ea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:46.298246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1fe51cab-a4e4-4fc7-a291-c3c72e97ea6d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:46.299850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1fe51cab-a4e4-4fc7-a291-c3c72e97ea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:46.375505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1114/2259] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:46.387029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:46.388695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:46.428567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:46.474558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a2e33-7616-46f6-980d-e69f2c224434 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:46.478924 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a678a1-d9a5-4b01-9d72-5a2749778815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:46.479543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a678a1-d9a5-4b01-9d72-5a2749778815 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:46.479847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a678a1-d9a5-4b01-9d72-5a2749778815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:46.480115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a678a1-d9a5-4b01-9d72-5a2749778815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:46.490016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a678a1-d9a5-4b01-9d72-5a2749778815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:46.491800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a678a1-d9a5-4b01-9d72-5a2749778815 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:46.506568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1146/2260] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:46.887849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51cab-a4e4-4fc7-a291-c3c72e97ea6d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:46.889277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1fe51cab-a4e4-4fc7-a291-c3c72e97ea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:46.933954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51cab-a4e4-4fc7-a291-c3c72e97ea6d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:46.945601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:46.946399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:46.946751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:46.947021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] PATH_INFO: `/v3/projects/0a2837ef5136442d8307e3c9722df400` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:46.948216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2837ef5136442d8307e3c9722df400)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:46.950294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:46.954220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:47.016053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2837ef5136442d8307e3c9722df400', 'request_id': 'req-fdec23e4-2181-413f-a088-c8ca425def57'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.025369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2837ef5136442d8307e3c9722df400', 'request_id': 'req-fdec23e4-2181-413f-a088-c8ca425def57'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.033372 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2837ef5136442d8307e3c9722df400', 'request_id': 'req-fdec23e4-2181-413f-a088-c8ca425def57'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.044526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] The token cache is being invalidate because project 0a2837ef5136442d8307e3c9722df400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:47.044810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.045425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.046958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1115/2261] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:46 2022] DELETE /identity/v3/projects/0a2837ef5136442d8307e3c9722df400 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:47.051782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a678a1-d9a5-4b01-9d72-5a2749778815 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:47.065878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a678a1-d9a5-4b01-9d72-5a2749778815 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:47.139346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:47.140086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:47.140304 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:47.140723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] PATH_INFO: `/v3/users/f14414a891cf4ed2a565d245ef456af9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:47.142293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14414a891cf4ed2a565d245ef456af9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:47.144386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:47.213977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14414a891cf4ed2a565d245ef456af9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.237041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14414a891cf4ed2a565d245ef456af9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.237795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14414a891cf4ed2a565d245ef456af9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.238484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14414a891cf4ed2a565d245ef456af9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.248421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7ef34044-b242-4532-b5e1-a1f8c776d07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14414a891cf4ed2a565d245ef456af9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.263649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1147/2262] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:47 2022] DELETE /identity/v3/users/f14414a891cf4ed2a565d245ef456af9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:47.601936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:47.604575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:47.636598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec23e4-2181-413f-a088-c8ca425def57 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:47.766525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:47.768247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:47.768711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:47.768987 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] PATH_INFO: `/v3/projects/aac90e3c6d084b5d94b86623d34cee8b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:47.770703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac90e3c6d084b5d94b86623d34cee8b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:47.773458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:47.837786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac90e3c6d084b5d94b86623d34cee8b', 'request_id': 'req-7df477c1-eef4-4abd-bc91-deea4a19953b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.850861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac90e3c6d084b5d94b86623d34cee8b', 'request_id': 'req-7df477c1-eef4-4abd-bc91-deea4a19953b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.858865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac90e3c6d084b5d94b86623d34cee8b', 'request_id': 'req-7df477c1-eef4-4abd-bc91-deea4a19953b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.876928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] The token cache is being invalidate because project aac90e3c6d084b5d94b86623d34cee8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:47.877582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.879333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7df477c1-eef4-4abd-bc91-deea4a19953b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:47.886149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1116/2263] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:47 2022] DELETE /identity/v3/projects/aac90e3c6d084b5d94b86623d34cee8b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:47.887888 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9085dd-59d0-4d7d-9425-7f19bb9c8a6f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:47.888172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9085dd-59d0-4d7d-9425-7f19bb9c8a6f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:47.888502 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9085dd-59d0-4d7d-9425-7f19bb9c8a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:47.913425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2e9085dd-59d0-4d7d-9425-7f19bb9c8a6f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:47.914704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2e9085dd-59d0-4d7d-9425-7f19bb9c8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:47.983464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:48.025154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1148/2264] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:48.035238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635d25-8e6a-4e46-a308-2c2245a81aad None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.035644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635d25-8e6a-4e46-a308-2c2245a81aad None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.035812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5635d25-8e6a-4e46-a308-2c2245a81aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.062705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b5635d25-8e6a-4e46-a308-2c2245a81aad None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:48.063946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b5635d25-8e6a-4e46-a308-2c2245a81aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:48.073729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1117/2265] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:48.078290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9085dd-59d0-4d7d-9425-7f19bb9c8a6f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.090637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9085dd-59d0-4d7d-9425-7f19bb9c8a6f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.097652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.098798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.100448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.101002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.102166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:48.102711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.105950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.131576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1149/2266] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:48.136317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5635d25-8e6a-4e46-a308-2c2245a81aad None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.151019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5635d25-8e6a-4e46-a308-2c2245a81aad None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.157317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e9c4-8d21-443a-8d10-6396737f8879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.158421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e9c4-8d21-443a-8d10-6396737f8879 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.159684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e9c4-8d21-443a-8d10-6396737f8879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.160178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e9c4-8d21-443a-8d10-6396737f8879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.161463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e9c4-8d21-443a-8d10-6396737f8879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.165793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e9c4-8d21-443a-8d10-6396737f8879 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.190886 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:48.226460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1118/2267] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:48 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:48.229652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.240819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba73145-bf70-476f-a549-bc03f40a1cdd admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.315738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f1dc8-db5e-410d-af94-0aab5b3bc7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.316332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1dc8-db5e-410d-af94-0aab5b3bc7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.316814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1dc8-db5e-410d-af94-0aab5b3bc7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.317081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1dc8-db5e-410d-af94-0aab5b3bc7dd admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.317721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f1dc8-db5e-410d-af94-0aab5b3bc7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.320720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f1dc8-db5e-410d-af94-0aab5b3bc7dd admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.349816 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1150/2268] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:48 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:48.351515 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e9c4-8d21-443a-8d10-6396737f8879 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.362661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e9c4-8d21-443a-8d10-6396737f8879 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.368563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196ef80-3691-4583-98c4-10f33a3eedd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.369502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196ef80-3691-4583-98c4-10f33a3eedd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.369502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196ef80-3691-4583-98c4-10f33a3eedd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.369849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196ef80-3691-4583-98c4-10f33a3eedd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.370495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196ef80-3691-4583-98c4-10f33a3eedd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.372724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196ef80-3691-4583-98c4-10f33a3eedd9 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.387116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1119/2269] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:48.392207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f1dc8-db5e-410d-af94-0aab5b3bc7dd admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.405582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f1dc8-db5e-410d-af94-0aab5b3bc7dd admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.418622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e3942-4a8a-4b95-ae5b-bdc9d169a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.419499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3942-4a8a-4b95-ae5b-bdc9d169a356 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.420092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3942-4a8a-4b95-ae5b-bdc9d169a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.420514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3942-4a8a-4b95-ae5b-bdc9d169a356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.421695 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e3942-4a8a-4b95-ae5b-bdc9d169a356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.424808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e3942-4a8a-4b95-ae5b-bdc9d169a356 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.443198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1151/2270] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:48.444506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196ef80-3691-4583-98c4-10f33a3eedd9 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.457892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196ef80-3691-4583-98c4-10f33a3eedd9 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.463686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5210-6ed3-4c58-8e58-cfbdf4cdb78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.464713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5210-6ed3-4c58-8e58-cfbdf4cdb78f admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.465486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5210-6ed3-4c58-8e58-cfbdf4cdb78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.465820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5210-6ed3-4c58-8e58-cfbdf4cdb78f admin admin] PATH_INFO: `/v3/projects/8e732cd871874b13a710486091319ca5/users/5de18224639941f5877d97ce2dc23b53/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.503704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f5210-6ed3-4c58-8e58-cfbdf4cdb78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e732cd871874b13a710486091319ca5, user_id=5de18224639941f5877d97ce2dc23b53, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.506621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f5210-6ed3-4c58-8e58-cfbdf4cdb78f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.522243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1120/2271] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:48 2022] PUT /identity/v3/projects/8e732cd871874b13a710486091319ca5/users/5de18224639941f5877d97ce2dc23b53/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:48.533675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900167-e3c8-4039-9283-45cd8dc6b92f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.533950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900167-e3c8-4039-9283-45cd8dc6b92f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.534235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900167-e3c8-4039-9283-45cd8dc6b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.567960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5b900167-e3c8-4039-9283-45cd8dc6b92f None None] MFA Rules not processed for user `5de18224639941f5877d97ce2dc23b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:48.569869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5b900167-e3c8-4039-9283-45cd8dc6b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:48.646952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1152/2272] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:48.651554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5210-6ed3-4c58-8e58-cfbdf4cdb78f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.737625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5210-6ed3-4c58-8e58-cfbdf4cdb78f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.744027 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ab4e-81e0-48aa-bcbe-700252fdec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.744633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ab4e-81e0-48aa-bcbe-700252fdec36 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.744919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ab4e-81e0-48aa-bcbe-700252fdec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.745189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ab4e-81e0-48aa-bcbe-700252fdec36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.745853 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228ab4e-81e0-48aa-bcbe-700252fdec36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.747868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228ab4e-81e0-48aa-bcbe-700252fdec36 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.793439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1121/2273] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:48 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:48.798274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900167-e3c8-4039-9283-45cd8dc6b92f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.820166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900167-e3c8-4039-9283-45cd8dc6b92f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.892065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:48.907731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5e75d-2e7c-467d-8d1e-a8dbf7077770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.908370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5e75d-2e7c-467d-8d1e-a8dbf7077770 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.908648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5e75d-2e7c-467d-8d1e-a8dbf7077770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.908916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5e75d-2e7c-467d-8d1e-a8dbf7077770 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.909567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5e75d-2e7c-467d-8d1e-a8dbf7077770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.911976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5e75d-2e7c-467d-8d1e-a8dbf7077770 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.942581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1153/2274] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:48 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:48.943753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ab4e-81e0-48aa-bcbe-700252fdec36 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:48.957778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ab4e-81e0-48aa-bcbe-700252fdec36 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:48.964028 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f81fe-ec5e-42a5-9151-82dc0b742ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:48.964539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f81fe-ec5e-42a5-9151-82dc0b742ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:48.965232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f81fe-ec5e-42a5-9151-82dc0b742ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:48.965943 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f81fe-ec5e-42a5-9151-82dc0b742ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:48.966328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f81fe-ec5e-42a5-9151-82dc0b742ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:48.968323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f81fe-ec5e-42a5-9151-82dc0b742ae8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:48.982417 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1122/2275] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:45:48.985764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5e75d-2e7c-467d-8d1e-a8dbf7077770 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:49.006611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5e75d-2e7c-467d-8d1e-a8dbf7077770 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:49.016901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:49.018264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:49.019138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:49.019701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] PATH_INFO: `/v3/projects/8db35bbc8685460b90882c5d5697837a/users/a579fa211c78459f857ad8b6bc810fd9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:49.046884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db35bbc8685460b90882c5d5697837a, user_id=a579fa211c78459f857ad8b6bc810fd9, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:49.050104 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:49.071810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1154/2276] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:48 2022] PUT /identity/v3/projects/8db35bbc8685460b90882c5d5697837a/users/a579fa211c78459f857ad8b6bc810fd9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:49.077729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f81fe-ec5e-42a5-9151-82dc0b742ae8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:49.094431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f81fe-ec5e-42a5-9151-82dc0b742ae8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:49.156740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:49.158552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:49.170726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970656f-06db-49ec-bf78-9d5cb2ff9d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:49.171456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970656f-06db-49ec-bf78-9d5cb2ff9d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:49.171726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970656f-06db-49ec-bf78-9d5cb2ff9d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:49.171982 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970656f-06db-49ec-bf78-9d5cb2ff9d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:49.172623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970656f-06db-49ec-bf78-9d5cb2ff9d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:49.174232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970656f-06db-49ec-bf78-9d5cb2ff9d66 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:49.185316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1123/2277] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:49.189644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970656f-06db-49ec-bf78-9d5cb2ff9d66 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:49.202952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970656f-06db-49ec-bf78-9d5cb2ff9d66 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:49.209341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21b418-b684-46ca-ad69-2448ca7d8a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:49.210107 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b418-b684-46ca-ad69-2448ca7d8a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:49.210416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b418-b684-46ca-ad69-2448ca7d8a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:49.210767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b418-b684-46ca-ad69-2448ca7d8a20 admin admin] PATH_INFO: `/v3/projects/8db35bbc8685460b90882c5d5697837a/users/a579fa211c78459f857ad8b6bc810fd9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:49.213419 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21b418-b684-46ca-ad69-2448ca7d8a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db35bbc8685460b90882c5d5697837a, user_id=a579fa211c78459f857ad8b6bc810fd9, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:49.220434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21b418-b684-46ca-ad69-2448ca7d8a20 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:49.233647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1124/2278] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:49 2022] PUT /identity/v3/projects/8db35bbc8685460b90882c5d5697837a/users/a579fa211c78459f857ad8b6bc810fd9/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:49.245495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838759-9b8b-4490-ad6d-4840652f96ab None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:49.246491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838759-9b8b-4490-ad6d-4840652f96ab None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:49.246753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838759-9b8b-4490-ad6d-4840652f96ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:49.257092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ffe9-f469-4fca-9844-168f6e1b2792 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:49.282872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:49.286867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-be838759-9b8b-4490-ad6d-4840652f96ab None None] MFA Rules not processed for user `a579fa211c78459f857ad8b6bc810fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:49.288108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-be838759-9b8b-4490-ad6d-4840652f96ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:49.355003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:49.355700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:49.356350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:49.356350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] PATH_INFO: `/v3/users/3a2c69bebccf47dd8f116694f0437227` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:49.357646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2c69bebccf47dd8f116694f0437227)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:49.359950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:49.381278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1125/2279] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:49.400690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be838759-9b8b-4490-ad6d-4840652f96ab None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:49.402369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-be838759-9b8b-4490-ad6d-4840652f96ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:49.445703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2c69bebccf47dd8f116694f0437227'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:49.457103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:49.461619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2c69bebccf47dd8f116694f0437227'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:49.462976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2c69bebccf47dd8f116694f0437227'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:49.464519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2c69bebccf47dd8f116694f0437227'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:49.474438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c475648c-de69-4b95-bc22-07c24f7485a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2c69bebccf47dd8f116694f0437227'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:49.483321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be838759-9b8b-4490-ad6d-4840652f96ab None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:49.487196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:49.487792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:49.488067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:49.488338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:49.489829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1155/2280] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:49 2022] DELETE /identity/v3/users/3a2c69bebccf47dd8f116694f0437227 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:49.500939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:49.502584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088128-c0bd-4696-96df-9dbb0215c2da None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:49.503800 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088128-c0bd-4696-96df-9dbb0215c2da None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:49.504081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088128-c0bd-4696-96df-9dbb0215c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:49.531046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-95088128-c0bd-4696-96df-9dbb0215c2da None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:49.532266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-95088128-c0bd-4696-96df-9dbb0215c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:49.605728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:49.607458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:49.619434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1156/2281] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:49.626039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1126/2282] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:45:49.630616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95088128-c0bd-4696-96df-9dbb0215c2da None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:49.632453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-95088128-c0bd-4696-96df-9dbb0215c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:49.743364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95088128-c0bd-4696-96df-9dbb0215c2da None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:49.747384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3287db6-2cac-43fd-97d3-ff432c18192f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:49.748190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3287db6-2cac-43fd-97d3-ff432c18192f service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:49.748469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3287db6-2cac-43fd-97d3-ff432c18192f service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:49.748776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3287db6-2cac-43fd-97d3-ff432c18192f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:49.766675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3287db6-2cac-43fd-97d3-ff432c18192f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:49.768209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3287db6-2cac-43fd-97d3-ff432c18192f service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:49.780993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1157/2283] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:50.122494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:50.124113 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:50.141474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054f026-710a-44a6-9c36-ba45736d766e service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:50.148730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:50.149401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:50.149665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:50.149961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] PATH_INFO: `/v3/projects/2cfd3a4581344ac5856587d5a7bfd128` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:50.151198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfd3a4581344ac5856587d5a7bfd128)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:50.153189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:50.206940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:50.209775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfd3a4581344ac5856587d5a7bfd128', 'request_id': 'req-8207a6db-d390-4344-b59d-0666e4bf70ff'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.218522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfd3a4581344ac5856587d5a7bfd128', 'request_id': 'req-8207a6db-d390-4344-b59d-0666e4bf70ff'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.228482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfd3a4581344ac5856587d5a7bfd128', 'request_id': 'req-8207a6db-d390-4344-b59d-0666e4bf70ff'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.243658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] The token cache is being invalidate because project 2cfd3a4581344ac5856587d5a7bfd128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:50.243948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.244766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.246643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1127/2284] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:50 2022] DELETE /identity/v3/projects/2cfd3a4581344ac5856587d5a7bfd128 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:50.251846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3287db6-2cac-43fd-97d3-ff432c18192f service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:50.262365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3287db6-2cac-43fd-97d3-ff432c18192f service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:50.335305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:50.335957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:50.336378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:50.336561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] PATH_INFO: `/v3/users/3eb5be6e4b7543808fa3a72b17a1977e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:50.337709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb5be6e4b7543808fa3a72b17a1977e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:50.339675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:50.368591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:50.402345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb5be6e4b7543808fa3a72b17a1977e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.425143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb5be6e4b7543808fa3a72b17a1977e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.426095 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb5be6e4b7543808fa3a72b17a1977e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.429392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb5be6e4b7543808fa3a72b17a1977e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.438716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4c275f95-e4cd-4c7e-8148-af38f304a282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb5be6e4b7543808fa3a72b17a1977e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:50.456990 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1158/2285] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:50 2022] DELETE /identity/v3/users/3eb5be6e4b7543808fa3a72b17a1977e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:50.926154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:50.930247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:50.982498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207a6db-d390-4344-b59d-0666e4bf70ff admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:51.085765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:51.086591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.086928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.087266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] PATH_INFO: `/v3/projects/2954e9b22d8a437b8fa8098f6cac25e0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.088780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2954e9b22d8a437b8fa8098f6cac25e0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:51.090854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:51.151061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2954e9b22d8a437b8fa8098f6cac25e0', 'request_id': 'req-6b45fc96-4c26-4215-84ca-46574147a879'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:51.161014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2954e9b22d8a437b8fa8098f6cac25e0', 'request_id': 'req-6b45fc96-4c26-4215-84ca-46574147a879'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:51.184864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2954e9b22d8a437b8fa8098f6cac25e0', 'request_id': 'req-6b45fc96-4c26-4215-84ca-46574147a879'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:51.207101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] The token cache is being invalidate because project 2954e9b22d8a437b8fa8098f6cac25e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:51.207550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:51.209076 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6b45fc96-4c26-4215-84ca-46574147a879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:51.212521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1128/2286] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:50 2022] DELETE /identity/v3/projects/2954e9b22d8a437b8fa8098f6cac25e0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:51.217682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f65d88-f553-4476-bc72-8bc0327b6f65 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.218154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f65d88-f553-4476-bc72-8bc0327b6f65 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.218464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f65d88-f553-4476-bc72-8bc0327b6f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.248010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-54f65d88-f553-4476-bc72-8bc0327b6f65 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:51.249537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-54f65d88-f553-4476-bc72-8bc0327b6f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:51.337914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1159/2287] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:51.354494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1000938-8947-4f4b-bf8e-c71979aa2873 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.354913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1000938-8947-4f4b-bf8e-c71979aa2873 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.355189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1000938-8947-4f4b-bf8e-c71979aa2873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.384011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e1000938-8947-4f4b-bf8e-c71979aa2873 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:51.385415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e1000938-8947-4f4b-bf8e-c71979aa2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:51.394003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1129/2288] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:51.401363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f65d88-f553-4476-bc72-8bc0327b6f65 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:51.413927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f65d88-f553-4476-bc72-8bc0327b6f65 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:51.419981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:51.421309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.421309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.421507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.422165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:51.422579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:51.424665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:51.445310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1160/2289] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:51.446464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1000938-8947-4f4b-bf8e-c71979aa2873 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:51.456121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1000938-8947-4f4b-bf8e-c71979aa2873 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:51.461063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e44b73-653c-4d5d-a074-8b20fdb10f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:51.461703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e44b73-653c-4d5d-a074-8b20fdb10f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.461986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e44b73-653c-4d5d-a074-8b20fdb10f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.462255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e44b73-653c-4d5d-a074-8b20fdb10f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.463563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e44b73-653c-4d5d-a074-8b20fdb10f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:51.465916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e44b73-653c-4d5d-a074-8b20fdb10f5b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:51.497211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1130/2290] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:51 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:51.502554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:51.515140 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62a1f-b57d-4089-afe0-20020f6066a3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:51.578035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8523f5-aaf6-4a6b-a1e7-4312d419fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:51.578662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8523f5-aaf6-4a6b-a1e7-4312d419fc9d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.578952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8523f5-aaf6-4a6b-a1e7-4312d419fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.579245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8523f5-aaf6-4a6b-a1e7-4312d419fc9d admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.579873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8523f5-aaf6-4a6b-a1e7-4312d419fc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:51.582176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8523f5-aaf6-4a6b-a1e7-4312d419fc9d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:51.606024 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1161/2291] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:51 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:51.612496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e44b73-653c-4d5d-a074-8b20fdb10f5b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:51.623489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e44b73-653c-4d5d-a074-8b20fdb10f5b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:51.628470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9879a7f-7c5e-4a4f-808f-0d90d1157845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:51.629707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9879a7f-7c5e-4a4f-808f-0d90d1157845 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.630563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9879a7f-7c5e-4a4f-808f-0d90d1157845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.630845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9879a7f-7c5e-4a4f-808f-0d90d1157845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.631482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9879a7f-7c5e-4a4f-808f-0d90d1157845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:51.633121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9879a7f-7c5e-4a4f-808f-0d90d1157845 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:51.644021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1131/2292] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:51.648961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8523f5-aaf6-4a6b-a1e7-4312d419fc9d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:51.661007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8523f5-aaf6-4a6b-a1e7-4312d419fc9d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:51.669332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee09e-e575-4d8f-9b7d-59c65b8d9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:51.670094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee09e-e575-4d8f-9b7d-59c65b8d9518 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.670675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee09e-e575-4d8f-9b7d-59c65b8d9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.671062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee09e-e575-4d8f-9b7d-59c65b8d9518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.671941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ee09e-e575-4d8f-9b7d-59c65b8d9518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:51.674181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ee09e-e575-4d8f-9b7d-59c65b8d9518 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:51.691683 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1162/2293] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:51.696502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9879a7f-7c5e-4a4f-808f-0d90d1157845 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:51.707833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9879a7f-7c5e-4a4f-808f-0d90d1157845 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:51.712656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0764-144e-480c-8588-584439e82b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:51.713324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0764-144e-480c-8588-584439e82b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.713595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0764-144e-480c-8588-584439e82b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.713871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0764-144e-480c-8588-584439e82b2b admin admin] PATH_INFO: `/v3/projects/04af6921b87440bba6cb829f32607a3c/users/14246698b2154991a0846ee0dc115d57/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.731575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa0764-144e-480c-8588-584439e82b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04af6921b87440bba6cb829f32607a3c, user_id=14246698b2154991a0846ee0dc115d57, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:51.734237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa0764-144e-480c-8588-584439e82b2b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:51.749040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1132/2294] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:51 2022] PUT /identity/v3/projects/04af6921b87440bba6cb829f32607a3c/users/14246698b2154991a0846ee0dc115d57/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:51.760834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ed066-f793-47f4-b9f2-c620ebcc4886 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:51.761106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ed066-f793-47f4-b9f2-c620ebcc4886 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:51.761377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ed066-f793-47f4-b9f2-c620ebcc4886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:51.778754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:51.799569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7e0ed066-f793-47f4-b9f2-c620ebcc4886 None None] MFA Rules not processed for user `14246698b2154991a0846ee0dc115d57`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:51.801330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7e0ed066-f793-47f4-b9f2-c620ebcc4886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:51.885526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1163/2295] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:51.889651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0764-144e-480c-8588-584439e82b2b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:51.894133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:51.988959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0764-144e-480c-8588-584439e82b2b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.000371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91adc52-435c-4885-9b03-f2b7baeb3b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.001098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91adc52-435c-4885-9b03-f2b7baeb3b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.001431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91adc52-435c-4885-9b03-f2b7baeb3b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.001786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91adc52-435c-4885-9b03-f2b7baeb3b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.002797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91adc52-435c-4885-9b03-f2b7baeb3b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.005028 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91adc52-435c-4885-9b03-f2b7baeb3b25 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.077816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1133/2296] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:51 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:52.081441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ed066-f793-47f4-b9f2-c620ebcc4886 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.102269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ed066-f793-47f4-b9f2-c620ebcc4886 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.175270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0b3f-6418-4094-ad14-789aa0970ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.175913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0b3f-6418-4094-ad14-789aa0970ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.176210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0b3f-6418-4094-ad14-789aa0970ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.176458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0b3f-6418-4094-ad14-789aa0970ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.177314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0b3f-6418-4094-ad14-789aa0970ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.179753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0b3f-6418-4094-ad14-789aa0970ac1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.209554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1164/2297] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:52 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:52.214510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91adc52-435c-4885-9b03-f2b7baeb3b25 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.225467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91adc52-435c-4885-9b03-f2b7baeb3b25 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.230683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390723d-9cf0-42cb-b100-4493f25f0220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.231310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390723d-9cf0-42cb-b100-4493f25f0220 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.231611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390723d-9cf0-42cb-b100-4493f25f0220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.231895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390723d-9cf0-42cb-b100-4493f25f0220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.232543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390723d-9cf0-42cb-b100-4493f25f0220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.234224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390723d-9cf0-42cb-b100-4493f25f0220 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.247057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1134/2298] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:52.251432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0b3f-6418-4094-ad14-789aa0970ac1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.263409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0b3f-6418-4094-ad14-789aa0970ac1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.269076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.269708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.269986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.270209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.270988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.272908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.284645 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1165/2299] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:52.290156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390723d-9cf0-42cb-b100-4493f25f0220 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.301492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390723d-9cf0-42cb-b100-4493f25f0220 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.307016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3af99f-0b1d-40c8-89a1-f9f280f2f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.307658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3af99f-0b1d-40c8-89a1-f9f280f2f853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.307929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3af99f-0b1d-40c8-89a1-f9f280f2f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.308194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3af99f-0b1d-40c8-89a1-f9f280f2f853 admin admin] PATH_INFO: `/v3/projects/805192c4ca4c441690e4a0d11a9362b8/users/f58e7958a2284fe3949a8448ac39ab4c/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.325594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3af99f-0b1d-40c8-89a1-f9f280f2f853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805192c4ca4c441690e4a0d11a9362b8, user_id=f58e7958a2284fe3949a8448ac39ab4c, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.328681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3af99f-0b1d-40c8-89a1-f9f280f2f853 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.348283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1135/2300] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:52 2022] PUT /identity/v3/projects/805192c4ca4c441690e4a0d11a9362b8/users/f58e7958a2284fe3949a8448ac39ab4c/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:52.354240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.356077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:52.359584 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b40eb-a30f-4384-936a-f620f2da6fd1 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.359941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b40eb-a30f-4384-936a-f620f2da6fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.360241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b40eb-a30f-4384-936a-f620f2da6fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.371200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e25ca0-2d08-4b02-a303-b756b822d330 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.397632 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-197b40eb-a30f-4384-936a-f620f2da6fd1 None None] MFA Rules not processed for user `f58e7958a2284fe3949a8448ac39ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:52.399258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-197b40eb-a30f-4384-936a-f620f2da6fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:52.452247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.452927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.453206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.453478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] PATH_INFO: `/v3/users/5de18224639941f5877d97ce2dc23b53` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.454808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de18224639941f5877d97ce2dc23b53)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.456735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.481936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:52.486445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1136/2301] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:52.491927 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b40eb-a30f-4384-936a-f620f2da6fd1 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.511137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b40eb-a30f-4384-936a-f620f2da6fd1 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.521923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.523138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.523675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.524595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.525313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.527821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.538037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de18224639941f5877d97ce2dc23b53'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:52.553997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de18224639941f5877d97ce2dc23b53'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:52.554818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de18224639941f5877d97ce2dc23b53'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:52.555450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de18224639941f5877d97ce2dc23b53'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:52.568172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-17cca906-44a7-484c-b993-f932214530b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de18224639941f5877d97ce2dc23b53'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:52.569123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1137/2302] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:52 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:52.573186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.575259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:52.592646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1166/2303] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:52 2022] DELETE /identity/v3/users/5de18224639941f5877d97ce2dc23b53 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:52.598706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2926-71cf-4bcd-8de2-c23c4c2949b3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.599048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2926-71cf-4bcd-8de2-c23c4c2949b3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.599332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2926-71cf-4bcd-8de2-c23c4c2949b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.606280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:52.621119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5f3a2926-71cf-4bcd-8de2-c23c4c2949b3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:52.622398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5f3a2926-71cf-4bcd-8de2-c23c4c2949b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:52.659722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d61ae-365d-4b85-9b21-b80c5014d07d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.707141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1167/2304] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:52.713682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2926-71cf-4bcd-8de2-c23c4c2949b3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.715274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5f3a2926-71cf-4bcd-8de2-c23c4c2949b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:52.732590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d496c-0a37-4c54-9fcd-fe3b1ee0d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.733103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d496c-0a37-4c54-9fcd-fe3b1ee0d613 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.733377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d496c-0a37-4c54-9fcd-fe3b1ee0d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.733645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d496c-0a37-4c54-9fcd-fe3b1ee0d613 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.734280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d496c-0a37-4c54-9fcd-fe3b1ee0d613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.736289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d496c-0a37-4c54-9fcd-fe3b1ee0d613 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.760243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1138/2305] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:52 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:52.764771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d496c-0a37-4c54-9fcd-fe3b1ee0d613 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.776401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d496c-0a37-4c54-9fcd-fe3b1ee0d613 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.781856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fcd20-7486-4a2b-80d5-0dc33ce2a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.782486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fcd20-7486-4a2b-80d5-0dc33ce2a700 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.782759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fcd20-7486-4a2b-80d5-0dc33ce2a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.783024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fcd20-7486-4a2b-80d5-0dc33ce2a700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.783657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fcd20-7486-4a2b-80d5-0dc33ce2a700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.785342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fcd20-7486-4a2b-80d5-0dc33ce2a700 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.789148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2926-71cf-4bcd-8de2-c23c4c2949b3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.794322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779a85-c8bd-4229-802d-98edfb3e1ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.794968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779a85-c8bd-4229-802d-98edfb3e1ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.795246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779a85-c8bd-4229-802d-98edfb3e1ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.795516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779a85-c8bd-4229-802d-98edfb3e1ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.799461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1139/2306] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:52.800568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fcd20-7486-4a2b-80d5-0dc33ce2a700 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.807139 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779a85-c8bd-4229-802d-98edfb3e1ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.808649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779a85-c8bd-4229-802d-98edfb3e1ab3 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.810832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fcd20-7486-4a2b-80d5-0dc33ce2a700 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.816002 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bd9d8-cb63-446f-af5d-92e962dbc506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.816782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd9d8-cb63-446f-af5d-92e962dbc506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.817062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd9d8-cb63-446f-af5d-92e962dbc506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.817330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bd9d8-cb63-446f-af5d-92e962dbc506 admin admin] PATH_INFO: `/v3/projects/a9b29ea92fae4ecea97574045917777b/users/0d3d4a39c81b4520936827259702e970/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.828130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1168/2307] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:45:52.835971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bd9d8-cb63-446f-af5d-92e962dbc506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b29ea92fae4ecea97574045917777b, user_id=0d3d4a39c81b4520936827259702e970, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.838797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bd9d8-cb63-446f-af5d-92e962dbc506 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.854536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1140/2308] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:52 2022] PUT /identity/v3/projects/a9b29ea92fae4ecea97574045917777b/users/0d3d4a39c81b4520936827259702e970/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:52.858706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779a85-c8bd-4229-802d-98edfb3e1ab3 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.869733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779a85-c8bd-4229-802d-98edfb3e1ab3 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.912115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:52.941425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26cbfc-4d86-4c17-8076-37e082cd8021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.942308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26cbfc-4d86-4c17-8076-37e082cd8021 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.942841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26cbfc-4d86-4c17-8076-37e082cd8021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.943200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26cbfc-4d86-4c17-8076-37e082cd8021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.944038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26cbfc-4d86-4c17-8076-37e082cd8021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.945860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26cbfc-4d86-4c17-8076-37e082cd8021 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:52.960183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1169/2309] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:52.961719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bd9d8-cb63-446f-af5d-92e962dbc506 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:52.973195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bd9d8-cb63-446f-af5d-92e962dbc506 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:52.978968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:52.979668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:52.979947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:52.980220 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] PATH_INFO: `/v3/projects/a9b29ea92fae4ecea97574045917777b/users/0d3d4a39c81b4520936827259702e970/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:52.982344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b29ea92fae4ecea97574045917777b, user_id=0d3d4a39c81b4520936827259702e970, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:52.985461 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:53.000109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1141/2310] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:52 2022] PUT /identity/v3/projects/a9b29ea92fae4ecea97574045917777b/users/0d3d4a39c81b4520936827259702e970/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:53.011020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdf9b-def0-47de-8afa-274ada4a1fd6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:53.011314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdf9b-def0-47de-8afa-274ada4a1fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:53.011604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdf9b-def0-47de-8afa-274ada4a1fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:53.053090 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c6bcdf9b-def0-47de-8afa-274ada4a1fd6 None None] MFA Rules not processed for user `0d3d4a39c81b4520936827259702e970`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:53.054605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c6bcdf9b-def0-47de-8afa-274ada4a1fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:53.201951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1170/2311] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:53.216320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:53.220929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:53.244874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdf9b-def0-47de-8afa-274ada4a1fd6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:53.246795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c6bcdf9b-def0-47de-8afa-274ada4a1fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:53.348154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdf9b-def0-47de-8afa-274ada4a1fd6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:53.353834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f0623-9ed5-499f-ae24-1a9f6c11a5bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:53.355004 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f0623-9ed5-499f-ae24-1a9f6c11a5bc service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:53.355932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f0623-9ed5-499f-ae24-1a9f6c11a5bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:53.356591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f0623-9ed5-499f-ae24-1a9f6c11a5bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:53.385529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9e041-e395-43f4-b8c0-2373a25ec9f0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:53.388385 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f0623-9ed5-499f-ae24-1a9f6c11a5bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:53.391961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f0623-9ed5-499f-ae24-1a9f6c11a5bc service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:53.393373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:53.395020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:53.395617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:53.397124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] PATH_INFO: `/v3/projects/8e732cd871874b13a710486091319ca5` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:53.413644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1171/2312] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:53.431089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e732cd871874b13a710486091319ca5)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:53.434720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:53.468697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:53.565560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e732cd871874b13a710486091319ca5', 'request_id': 'req-8131b664-7255-4b25-99dc-e8c4e93d4aa0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.576335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e732cd871874b13a710486091319ca5', 'request_id': 'req-8131b664-7255-4b25-99dc-e8c4e93d4aa0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.598350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e732cd871874b13a710486091319ca5', 'request_id': 'req-8131b664-7255-4b25-99dc-e8c4e93d4aa0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.617732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] The token cache is being invalidate because project 8e732cd871874b13a710486091319ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:53.618024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.618730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.622481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1142/2313] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:53 2022] DELETE /identity/v3/projects/8e732cd871874b13a710486091319ca5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:53.627703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f0623-9ed5-499f-ae24-1a9f6c11a5bc service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:53.641852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f0623-9ed5-499f-ae24-1a9f6c11a5bc service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:53.752177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:53.752779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:53.753052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:53.753326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] PATH_INFO: `/v3/users/a579fa211c78459f857ad8b6bc810fd9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:53.754501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a579fa211c78459f857ad8b6bc810fd9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:53.756706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:53.759609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:53.839640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a579fa211c78459f857ad8b6bc810fd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.856041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a579fa211c78459f857ad8b6bc810fd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.856783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a579fa211c78459f857ad8b6bc810fd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.857375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a579fa211c78459f857ad8b6bc810fd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.869681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a579fa211c78459f857ad8b6bc810fd9'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:53.885629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1172/2314] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:45:53 2022] DELETE /identity/v3/users/a579fa211c78459f857ad8b6bc810fd9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:54.176404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:54.179492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:54.215245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:54.217358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:54.262063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131b664-7255-4b25-99dc-e8c4e93d4aa0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:54.319781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937f506-5bfc-41a0-9d5a-959eb7783bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:54.320510 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937f506-5bfc-41a0-9d5a-959eb7783bca service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:54.320680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ef81-5497-4550-9861-a0c9bfecac8f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:54.320826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937f506-5bfc-41a0-9d5a-959eb7783bca service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:54.321035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937f506-5bfc-41a0-9d5a-959eb7783bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:54.323090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2937f506-5bfc-41a0-9d5a-959eb7783bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:54.325443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:54.326051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:54.326342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:54.326635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] PATH_INFO: `/v3/projects/8db35bbc8685460b90882c5d5697837a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:54.327803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db35bbc8685460b90882c5d5697837a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:54.329679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:54.387461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db35bbc8685460b90882c5d5697837a', 'request_id': 'req-70b69695-57ec-4c67-9aac-3d0f87ff855d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:54.394108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937f506-5bfc-41a0-9d5a-959eb7783bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:54.395624 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937f506-5bfc-41a0-9d5a-959eb7783bca service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:54.397076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db35bbc8685460b90882c5d5697837a', 'request_id': 'req-70b69695-57ec-4c67-9aac-3d0f87ff855d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:54.406775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db35bbc8685460b90882c5d5697837a', 'request_id': 'req-70b69695-57ec-4c67-9aac-3d0f87ff855d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:54.407297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1143/2315] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:54.427509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] The token cache is being invalidate because project 8db35bbc8685460b90882c5d5697837a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:45:54.428029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:54.429169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-70b69695-57ec-4c67-9aac-3d0f87ff855d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:45:54.431828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1173/2316] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:45:54 2022] DELETE /identity/v3/projects/8db35bbc8685460b90882c5d5697837a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:45:54.437476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3807a-6b55-43e9-9b09-e104f6f76d75 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:54.437836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3807a-6b55-43e9-9b09-e104f6f76d75 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:54.438122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3807a-6b55-43e9-9b09-e104f6f76d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:54.459790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e3d3807a-6b55-43e9-9b09-e104f6f76d75 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:54.461039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e3d3807a-6b55-43e9-9b09-e104f6f76d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:54.465765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:54.543800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1144/2317] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:54.553313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9833db-269f-4f70-ab14-154786a31e95 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:54.553916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9833db-269f-4f70-ab14-154786a31e95 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:54.557050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9833db-269f-4f70-ab14-154786a31e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:54.576161 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-dc9833db-269f-4f70-ab14-154786a31e95 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:54.577001 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dc9833db-269f-4f70-ab14-154786a31e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:54.589533 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1174/2318] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:54.594577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3807a-6b55-43e9-9b09-e104f6f76d75 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:54.608731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3807a-6b55-43e9-9b09-e104f6f76d75 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:54.636421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:54.637087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:54.637338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:54.637711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:54.638410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:45:54.638712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:54.642577 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:54.657895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1145/2319] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:45:54.662812 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9833db-269f-4f70-ab14-154786a31e95 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:54.669616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:54.676174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9833db-269f-4f70-ab14-154786a31e95 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:54.695162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673f03c-9c5c-48ad-a10f-82287ad7ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:54.695810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673f03c-9c5c-48ad-a10f-82287ad7ed8e admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:54.697153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673f03c-9c5c-48ad-a10f-82287ad7ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:54.697577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673f03c-9c5c-48ad-a10f-82287ad7ed8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:54.698242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673f03c-9c5c-48ad-a10f-82287ad7ed8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:54.700230 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673f03c-9c5c-48ad-a10f-82287ad7ed8e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:54.786436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1175/2320] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:45:54 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:45:54.788316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:54.804643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a793e-a959-46ad-b8f9-2c3c5513b499 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:54.903959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539616-9778-46cd-8513-8e5e50742280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:54.905149 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539616-9778-46cd-8513-8e5e50742280 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:54.905567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539616-9778-46cd-8513-8e5e50742280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:54.906094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539616-9778-46cd-8513-8e5e50742280 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:54.906919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58539616-9778-46cd-8513-8e5e50742280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:54.910177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58539616-9778-46cd-8513-8e5e50742280 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:54.940864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1146/2321] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:45:54 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:45:54.946113 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673f03c-9c5c-48ad-a10f-82287ad7ed8e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:54.958839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673f03c-9c5c-48ad-a10f-82287ad7ed8e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:54.965151 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9a11-a971-4035-a5de-dc3f3964fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:54.966156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9a11-a971-4035-a5de-dc3f3964fa09 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:54.966478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9a11-a971-4035-a5de-dc3f3964fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:54.966751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9a11-a971-4035-a5de-dc3f3964fa09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:54.967413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a9a11-a971-4035-a5de-dc3f3964fa09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:54.969076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a9a11-a971-4035-a5de-dc3f3964fa09 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:54.982842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1176/2322] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:54.986953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539616-9778-46cd-8513-8e5e50742280 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:54.999124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539616-9778-46cd-8513-8e5e50742280 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:55.004200 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc30e8-98ac-43c0-bc73-da75942dc22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:55.004852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc30e8-98ac-43c0-bc73-da75942dc22b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:55.005280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc30e8-98ac-43c0-bc73-da75942dc22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:55.005450 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc30e8-98ac-43c0-bc73-da75942dc22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:55.006105 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc30e8-98ac-43c0-bc73-da75942dc22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:55.007925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc30e8-98ac-43c0-bc73-da75942dc22b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:55.021199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1147/2323] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:45:55.025964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9a11-a971-4035-a5de-dc3f3964fa09 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:55.037620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9a11-a971-4035-a5de-dc3f3964fa09 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:55.042703 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:55.043716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:55.043862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:55.044128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] PATH_INFO: `/v3/projects/a016b08be8f74963817782336c9638a6/users/87f59c8ddada4de6849d6a08ae7c846d/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:55.066184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a016b08be8f74963817782336c9638a6, user_id=87f59c8ddada4de6849d6a08ae7c846d, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:55.069144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:55.087024 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1177/2324] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:45:55 2022] PUT /identity/v3/projects/a016b08be8f74963817782336c9638a6/users/87f59c8ddada4de6849d6a08ae7c846d/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:45:55.092559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be3b59-aed7-4fbe-9d90-96fdade37bd3 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:55.092847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be3b59-aed7-4fbe-9d90-96fdade37bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:55.093138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be3b59-aed7-4fbe-9d90-96fdade37bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:55.115833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f8be3b59-aed7-4fbe-9d90-96fdade37bd3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:55.117433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f8be3b59-aed7-4fbe-9d90-96fdade37bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:55.186923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1148/2325] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:45:55.197788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:55.199899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:55.265868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca8e7d-dd53-4296-9569-9b70a8ab0e53 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:55.270342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:55.278860 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:55.279416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:55.280563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:55.294089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:55.296180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:55.308853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1178/2326] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:56.256251 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ce29-4a71-4f42-8961-d238da46adfd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:56.257099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ce29-4a71-4f42-8961-d238da46adfd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:56.257099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ce29-4a71-4f42-8961-d238da46adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:56.293881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f418ce29-4a71-4f42-8961-d238da46adfd None None] MFA Rules not processed for user `87f59c8ddada4de6849d6a08ae7c846d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:56.295272 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f418ce29-4a71-4f42-8961-d238da46adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:56.301132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:56.460516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1149/2327] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:56.473254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:56.476463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:56.565289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf8411-0c37-418c-a6ea-3c9e387fc455 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:56.569782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:56.570534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:56.570902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:56.571480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:56.584916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:56.586225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:56.598430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1179/2328] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:45:57.995275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077320-a351-448c-814a-0a189551465b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:57.995909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077320-a351-448c-814a-0a189551465b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:57.996026 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077320-a351-448c-814a-0a189551465b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:58.016964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b7077320-a351-448c-814a-0a189551465b None None] MFA Rules not processed for user `87f59c8ddada4de6849d6a08ae7c846d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:45:58.018159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b7077320-a351-448c-814a-0a189551465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:58.026241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1150/2329] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:45:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:45:58.795929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:45:58.798082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:58.828058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe49410-2b4d-4354-b714-c533bc20cde1 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:45:58.832623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc0770-18ec-4d58-9010-a85483fc9c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:45:58.834846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0770-18ec-4d58-9010-a85483fc9c4f service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:45:58.835437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0770-18ec-4d58-9010-a85483fc9c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:45:58.836608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc0770-18ec-4d58-9010-a85483fc9c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:45:58.839175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-83fc0770-18ec-4d58-9010-a85483fc9c4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:45:58.918560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:58.935867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc0770-18ec-4d58-9010-a85483fc9c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:45:58.938314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc0770-18ec-4d58-9010-a85483fc9c4f service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:45:58.949758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1180/2330] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:45:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:01.690835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7077320-a351-448c-814a-0a189551465b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:01.693926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b7077320-a351-448c-814a-0a189551465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:01.711544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7077320-a351-448c-814a-0a189551465b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:01.744834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:01.745534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:01.745811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:01.746086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] PATH_INFO: `/v3/users/14246698b2154991a0846ee0dc115d57` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:01.752995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14246698b2154991a0846ee0dc115d57)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:01.755266 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:01.772603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9fd0-8bca-4731-8946-566bd6742e98 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:01.773218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9fd0-8bca-4731-8946-566bd6742e98 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:01.773218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c9fd0-8bca-4731-8946-566bd6742e98 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:01.775002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1181/2331] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:46:01.787250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f23a6-4459-4c51-b743-59dd8fab5ece None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:01.787774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f23a6-4459-4c51-b743-59dd8fab5ece None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:01.788255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f23a6-4459-4c51-b743-59dd8fab5ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:01.816185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-970f23a6-4459-4c51-b743-59dd8fab5ece None None] MFA Rules not processed for user `64e595269cd746d68edd59783c1d6314`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:01.818295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-970f23a6-4459-4c51-b743-59dd8fab5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:01.845767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14246698b2154991a0846ee0dc115d57'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:01.877589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14246698b2154991a0846ee0dc115d57'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:01.889984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14246698b2154991a0846ee0dc115d57'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:01.892482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14246698b2154991a0846ee0dc115d57'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:01.894871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-d22903ed-a165-4032-b6db-9b7d4b581c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14246698b2154991a0846ee0dc115d57'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:01.916548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1151/2332] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:01 2022] DELETE /identity/v3/users/14246698b2154991a0846ee0dc115d57 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:01.921711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f5b3c-ddb1-433b-92ed-e14bf589ab6e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:01.923000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f5b3c-ddb1-433b-92ed-e14bf589ab6e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:01.923000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f5b3c-ddb1-433b-92ed-e14bf589ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:01.955158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1182/2333] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:01.968307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-aa2f5b3c-ddb1-433b-92ed-e14bf589ab6e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:01.970619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-aa2f5b3c-ddb1-433b-92ed-e14bf589ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:01.997365 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f23a6-4459-4c51-b743-59dd8fab5ece None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:01.999742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-970f23a6-4459-4c51-b743-59dd8fab5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:02.017454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f23a6-4459-4c51-b743-59dd8fab5ece None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:02.047453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1152/2334] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:02.076553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f5b3c-ddb1-433b-92ed-e14bf589ab6e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:02.078493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-aa2f5b3c-ddb1-433b-92ed-e14bf589ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:02.111260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:02.140671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:02.141660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:02.144457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:02.145475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:02.172489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:02.181459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:02.204153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1183/2335] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:02.205150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f5b3c-ddb1-433b-92ed-e14bf589ab6e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:02.209085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4811f2-9396-4777-9917-946e00d1987f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:02.210723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4811f2-9396-4777-9917-946e00d1987f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:02.211273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4811f2-9396-4777-9917-946e00d1987f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:02.211637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4811f2-9396-4777-9917-946e00d1987f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:02.225378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4811f2-9396-4777-9917-946e00d1987f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:02.227189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4811f2-9396-4777-9917-946e00d1987f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:02.248982 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1153/2336] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:46:03.604889 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:03.606685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:03.628347 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b975-4755-4ecb-a704-a8b999b1385e service placement] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:03.637687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:03.639020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:03.639634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:03.640269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] PATH_INFO: `/v3/projects/04af6921b87440bba6cb829f32607a3c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:03.642663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] RBAC: Authorizing `identity:delete_project(project_id=04af6921b87440bba6cb829f32607a3c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:03.647159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:03.740863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04af6921b87440bba6cb829f32607a3c', 'request_id': 'req-b6107aac-2af5-49d2-b77b-f81e1122accc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:03.748701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04af6921b87440bba6cb829f32607a3c', 'request_id': 'req-b6107aac-2af5-49d2-b77b-f81e1122accc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:03.755211 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04af6921b87440bba6cb829f32607a3c', 'request_id': 'req-b6107aac-2af5-49d2-b77b-f81e1122accc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:03.769964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:03.777003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] The token cache is being invalidate because project 04af6921b87440bba6cb829f32607a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:03.777613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:03.778995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:03.782908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1184/2337] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:03 2022] DELETE /identity/v3/projects/04af6921b87440bba6cb829f32607a3c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:03.787298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4811f2-9396-4777-9917-946e00d1987f service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:03.807110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4811f2-9396-4777-9917-946e00d1987f service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:03.893779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:03.894364 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:03.894680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:03.894939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] PATH_INFO: `/v3/users/f58e7958a2284fe3949a8448ac39ab4c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:03.896162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58e7958a2284fe3949a8448ac39ab4c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:03.898144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:03.915819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:03.917291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:03.945709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107aac-2af5-49d2-b77b-f81e1122accc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:03.951748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:03.952435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:03.952705 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:03.953060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] PATH_INFO: `/v3/users/b8e3203a64914016a86d84b1aae3a496` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:03.954136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e3203a64914016a86d84b1aae3a496)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:03.956123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:03.984955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58e7958a2284fe3949a8448ac39ab4c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.014612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58e7958a2284fe3949a8448ac39ab4c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.024832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58e7958a2284fe3949a8448ac39ab4c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.025948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58e7958a2284fe3949a8448ac39ab4c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.026634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58e7958a2284fe3949a8448ac39ab4c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.032944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e3203a64914016a86d84b1aae3a496'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.045711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1154/2338] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:03 2022] DELETE /identity/v3/users/f58e7958a2284fe3949a8448ac39ab4c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:46:04.051700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e3203a64914016a86d84b1aae3a496'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.053621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e3203a64914016a86d84b1aae3a496'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.054327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e3203a64914016a86d84b1aae3a496'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.066175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e3203a64914016a86d84b1aae3a496'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.085340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1185/2339] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:03 2022] DELETE /identity/v3/users/b8e3203a64914016a86d84b1aae3a496 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:04.417883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:04.431169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:04.520400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:04.588237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411ddb-c6b4-4f7f-96d3-6c6dc6f9fc74 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:04.601675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:04.603898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:04.718972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:04.719849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:04.720195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:04.720668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] PATH_INFO: `/v3/projects/7976ea592d544da08c5102f5d97ac396` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:04.722336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7976ea592d544da08c5102f5d97ac396)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:04.725285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:04.746766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4615978-68c0-4771-90f5-89f01b1d7185 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:04.752571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:04.753343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:04.753831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:04.754209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] PATH_INFO: `/v3/projects/805192c4ca4c441690e4a0d11a9362b8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:04.755761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=805192c4ca4c441690e4a0d11a9362b8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:04.758087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:04.795330 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7976ea592d544da08c5102f5d97ac396', 'request_id': 'req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.805529 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7976ea592d544da08c5102f5d97ac396', 'request_id': 'req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.818120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7976ea592d544da08c5102f5d97ac396', 'request_id': 'req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.845246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805192c4ca4c441690e4a0d11a9362b8', 'request_id': 'req-a4b9cb97-b533-4b12-add8-64d047071b6b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.850305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] The token cache is being invalidate because project 7976ea592d544da08c5102f5d97ac396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:04.850955 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.851904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.859712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1155/2340] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:04 2022] DELETE /identity/v3/projects/7976ea592d544da08c5102f5d97ac396 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:04.861456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805192c4ca4c441690e4a0d11a9362b8', 'request_id': 'req-a4b9cb97-b533-4b12-add8-64d047071b6b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.864635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:04.866859 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:04.881362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805192c4ca4c441690e4a0d11a9362b8', 'request_id': 'req-a4b9cb97-b533-4b12-add8-64d047071b6b'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.909352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] The token cache is being invalidate because project 805192c4ca4c441690e4a0d11a9362b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:04.909612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.913055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:04.919635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1186/2341] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:04 2022] DELETE /identity/v3/projects/805192c4ca4c441690e4a0d11a9362b8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:04.924393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:04.926940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:04.935299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:05.070403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5339d-e41e-4f5e-89f0-7ec3ac52e3cf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:05.080991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:05.096254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9cb97-b533-4b12-add8-64d047071b6b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:05.105855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:05.107126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:05.107786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:05.108486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] PATH_INFO: `/v3/users/0d3d4a39c81b4520936827259702e970` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:05.110851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3d4a39c81b4520936827259702e970)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:05.115202 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:05.151088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:05.152158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:05.152649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:05.153132 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] PATH_INFO: `/v3/users/9913c6bcf263447bba6895822c209c62` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:05.156218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9913c6bcf263447bba6895822c209c62)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:05.158599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:05.196891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3d4a39c81b4520936827259702e970'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.224605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3d4a39c81b4520936827259702e970'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.225865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3d4a39c81b4520936827259702e970'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.227352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3d4a39c81b4520936827259702e970'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.229643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9913c6bcf263447bba6895822c209c62'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.241932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3d4a39c81b4520936827259702e970'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.244148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9913c6bcf263447bba6895822c209c62'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.251622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9913c6bcf263447bba6895822c209c62'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.252470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9913c6bcf263447bba6895822c209c62'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.253079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9913c6bcf263447bba6895822c209c62'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.261137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1187/2342] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:04 2022] DELETE /identity/v3/users/0d3d4a39c81b4520936827259702e970 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:05.275545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1156/2343] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:04 2022] DELETE /identity/v3/users/9913c6bcf263447bba6895822c209c62 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:46:05.480462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:05.482788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:05.767685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ba122-78af-4281-bc42-1d6b462da497 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:05.806603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:05.871591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:05.872786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:05.873060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:05.873331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] PATH_INFO: `/v3/projects/7c363752b88741eca618d48bb4ed6e3f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:05.874677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c363752b88741eca618d48bb4ed6e3f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:05.876617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:05.916435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:05.918021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:05.943084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a8096-4efd-4572-9b0c-227a453ff9c0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:05.970047 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c363752b88741eca618d48bb4ed6e3f', 'request_id': 'req-ff508216-9e54-4403-b151-bc1a89ca51f0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.978272 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c363752b88741eca618d48bb4ed6e3f', 'request_id': 'req-ff508216-9e54-4403-b151-bc1a89ca51f0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:05.986216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c363752b88741eca618d48bb4ed6e3f', 'request_id': 'req-ff508216-9e54-4403-b151-bc1a89ca51f0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:06.003032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] The token cache is being invalidate because project 7c363752b88741eca618d48bb4ed6e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:06.003320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:06.004065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff508216-9e54-4403-b151-bc1a89ca51f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:06.009665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1188/2344] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:05 2022] DELETE /identity/v3/projects/7c363752b88741eca618d48bb4ed6e3f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:46:06.011506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ba4f-0ad1-4028-b54b-3c86bac47578 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.011722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ba4f-0ad1-4028-b54b-3c86bac47578 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.012125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ba4f-0ad1-4028-b54b-3c86bac47578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.027199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.028025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.028305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.028696 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] PATH_INFO: `/v3/projects/a9b29ea92fae4ecea97574045917777b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.029928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b29ea92fae4ecea97574045917777b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.031988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.052570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b103ba4f-0ad1-4028-b54b-3c86bac47578 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:06.054588 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b103ba4f-0ad1-4028-b54b-3c86bac47578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:06.072467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1189/2345] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:06.074237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40558f88-4ccf-4ebb-b67b-3ea6464fa689 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.074564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40558f88-4ccf-4ebb-b67b-3ea6464fa689 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.074840 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40558f88-4ccf-4ebb-b67b-3ea6464fa689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.115389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-40558f88-4ccf-4ebb-b67b-3ea6464fa689 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:06.120066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-40558f88-4ccf-4ebb-b67b-3ea6464fa689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:06.120973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:06.139548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b29ea92fae4ecea97574045917777b', 'request_id': 'req-11dbfc7c-b379-4a83-9f65-ee417293b090'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:06.160760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b29ea92fae4ecea97574045917777b', 'request_id': 'req-11dbfc7c-b379-4a83-9f65-ee417293b090'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:06.180031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b29ea92fae4ecea97574045917777b', 'request_id': 'req-11dbfc7c-b379-4a83-9f65-ee417293b090'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:06.202444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] The token cache is being invalidate because project a9b29ea92fae4ecea97574045917777b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:06.202656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:06.203257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-11dbfc7c-b379-4a83-9f65-ee417293b090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:06.210637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1157/2346] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:05 2022] DELETE /identity/v3/projects/a9b29ea92fae4ecea97574045917777b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:06.213199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973da6d4-2d65-4b00-82a7-2cb71bb5f4d9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.213199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973da6d4-2d65-4b00-82a7-2cb71bb5f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.213511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973da6d4-2d65-4b00-82a7-2cb71bb5f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.243271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-973da6d4-2d65-4b00-82a7-2cb71bb5f4d9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:06.244752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-973da6d4-2d65-4b00-82a7-2cb71bb5f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:06.305158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1190/2347] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:06.309546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40558f88-4ccf-4ebb-b67b-3ea6464fa689 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.338923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40558f88-4ccf-4ebb-b67b-3ea6464fa689 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:06.348944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.350270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.350885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.352125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.352995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:46:06.353421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.362963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.393779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1191/2348] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:46:06.394946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.411414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11944b6-fcdf-4397-aeba-1af9e318e9a8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:06.416483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d41085-1da4-459c-bb7d-863405559927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.417524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d41085-1da4-459c-bb7d-863405559927 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.418682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d41085-1da4-459c-bb7d-863405559927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.419330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d41085-1da4-459c-bb7d-863405559927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.420176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d41085-1da4-459c-bb7d-863405559927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.422751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d41085-1da4-459c-bb7d-863405559927 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.437768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1158/2349] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:06.447804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9384-06cf-4265-9a11-94cd92e4b0cc None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.448097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9384-06cf-4265-9a11-94cd92e4b0cc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.448373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9384-06cf-4265-9a11-94cd92e4b0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.474982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1192/2350] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:06.476586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d41085-1da4-459c-bb7d-863405559927 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.489987 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c2ee9384-06cf-4265-9a11-94cd92e4b0cc None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:06.490931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c2ee9384-06cf-4265-9a11-94cd92e4b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:06.518782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:06.604667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d41085-1da4-459c-bb7d-863405559927 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:06.616834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5308840-1980-40a4-802a-b1cc327befef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.617856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5308840-1980-40a4-802a-b1cc327befef admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.618158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5308840-1980-40a4-802a-b1cc327befef admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.619238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5308840-1980-40a4-802a-b1cc327befef admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.620161 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5308840-1980-40a4-802a-b1cc327befef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.622620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5308840-1980-40a4-802a-b1cc327befef admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.639581 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1159/2351] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:06.642098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c95d4-f0ba-4965-ad81-35f26d71cda6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.642723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c95d4-f0ba-4965-ad81-35f26d71cda6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.642997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c95d4-f0ba-4965-ad81-35f26d71cda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.655237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1193/2352] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:06.659377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5308840-1980-40a4-802a-b1cc327befef admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.682099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-035c95d4-f0ba-4965-ad81-35f26d71cda6 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:06.683369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-035c95d4-f0ba-4965-ad81-35f26d71cda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:06.685532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5308840-1980-40a4-802a-b1cc327befef admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:06.695942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.696572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.696846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.697116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.697771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:46:06.698332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.701172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.736632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1194/2353] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:46:06.736632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.759774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c79c00-a03c-4bdc-a2ab-ef946a6ceb9b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:06.767228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e58f-ab8d-44d6-b5a7-bdc2cdb3f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.768271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e58f-ab8d-44d6-b5a7-bdc2cdb3f79f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.769170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e58f-ab8d-44d6-b5a7-bdc2cdb3f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.769592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e58f-ab8d-44d6-b5a7-bdc2cdb3f79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.770495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e58f-ab8d-44d6-b5a7-bdc2cdb3f79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.773220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e58f-ab8d-44d6-b5a7-bdc2cdb3f79f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.790825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1195/2354] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:06.792355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e58f-ab8d-44d6-b5a7-bdc2cdb3f79f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.797673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1160/2355] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:06.798797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c95d4-f0ba-4965-ad81-35f26d71cda6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.813110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c95d4-f0ba-4965-ad81-35f26d71cda6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:06.816903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e58f-ab8d-44d6-b5a7-bdc2cdb3f79f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:06.819755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8485f1a-9cfd-4dee-9223-4cef99bfb1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.820631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8485f1a-9cfd-4dee-9223-4cef99bfb1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.820872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8485f1a-9cfd-4dee-9223-4cef99bfb1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.821217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8485f1a-9cfd-4dee-9223-4cef99bfb1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.822044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8485f1a-9cfd-4dee-9223-4cef99bfb1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.824376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.824728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8485f1a-9cfd-4dee-9223-4cef99bfb1c6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.826222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.827019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.827478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.829728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.832953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.845705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1161/2356] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:06.850458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8485f1a-9cfd-4dee-9223-4cef99bfb1c6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.857730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:06.869194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8485f1a-9cfd-4dee-9223-4cef99bfb1c6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:06.881822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550e07-6a8e-4b08-a120-8903edfb2419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:06.882735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550e07-6a8e-4b08-a120-8903edfb2419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:06.883228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550e07-6a8e-4b08-a120-8903edfb2419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:06.883501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550e07-6a8e-4b08-a120-8903edfb2419 admin admin] PATH_INFO: `/v3/projects/fa1629cc99304a78834f18559664d266/users/73e0c7c07e87472898f9f9269ad897d8/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:06.894240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1196/2357] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:06.894240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:06.896694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:06.907349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9550e07-6a8e-4b08-a120-8903edfb2419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1629cc99304a78834f18559664d266, user_id=73e0c7c07e87472898f9f9269ad897d8, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:06.910655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9550e07-6a8e-4b08-a120-8903edfb2419 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:06.932439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1162/2358] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:06 2022] PUT /identity/v3/projects/fa1629cc99304a78834f18559664d266/users/73e0c7c07e87472898f9f9269ad897d8/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:06.934174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550e07-6a8e-4b08-a120-8903edfb2419 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:07.023531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a88c57-5579-4d24-8174-918954abb065 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:07.045498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550e07-6a8e-4b08-a120-8903edfb2419 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:07.052110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:07.054185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.054185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.054185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.055445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:07.056938 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:07.092426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1163/2359] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:06 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:07.101565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:07.105911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:07.125315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b37f9-d64e-4860-8392-74834cd30d00 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:07.130972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:07.132080 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.132380 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.132653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] PATH_INFO: `/v3/users/ea2c8da18b5e4e409667afc09dce09dd` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.134223 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2c8da18b5e4e409667afc09dce09dd)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:07.137333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:07.144051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb81b15-654d-4162-96c4-156a55235ac9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:07.146357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81b15-654d-4162-96c4-156a55235ac9 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.147142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81b15-654d-4162-96c4-156a55235ac9 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.147669 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81b15-654d-4162-96c4-156a55235ac9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.162815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:07.243586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2c8da18b5e4e409667afc09dce09dd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:07.274438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb81b15-654d-4162-96c4-156a55235ac9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:07.277430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb81b15-654d-4162-96c4-156a55235ac9 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:07.277814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2c8da18b5e4e409667afc09dce09dd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:07.292811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1197/2360] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:46:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:46:07.295042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47a003-382e-4e13-9488-657cd9fd1810 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.295621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47a003-382e-4e13-9488-657cd9fd1810 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.296278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47a003-382e-4e13-9488-657cd9fd1810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.310654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2c8da18b5e4e409667afc09dce09dd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:07.314826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2c8da18b5e4e409667afc09dce09dd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:07.318066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2c8da18b5e4e409667afc09dce09dd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:07.356486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ca47a003-382e-4e13-9488-657cd9fd1810 None None] MFA Rules not processed for user `73e0c7c07e87472898f9f9269ad897d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:07.358684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ca47a003-382e-4e13-9488-657cd9fd1810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:07.400077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1164/2361] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:07 2022] DELETE /identity/v3/users/ea2c8da18b5e4e409667afc09dce09dd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:07.403429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:07.407868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:07.533228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:07.558631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1198/2362] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:07.558759 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff27b7-1a0f-4697-a411-e36828a5d120 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.559021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff27b7-1a0f-4697-a411-e36828a5d120 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.559269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff27b7-1a0f-4697-a411-e36828a5d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.588314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a8e1b-e614-4f3b-b1e2-bf2f3e3a078f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:07.597500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:07.600174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.601197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.601590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.603274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:07.605539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:07.633103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1165/2363] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:07.634012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:07.637028 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:07.648891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-10ff27b7-1a0f-4697-a411-e36828a5d120 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:07.652395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-10ff27b7-1a0f-4697-a411-e36828a5d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:07.669970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33a8b-dcaf-4ac0-9848-8e59c12fc6b2 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:07.670835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1199/2364] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:07.676720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff27b7-1a0f-4697-a411-e36828a5d120 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:07.691598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ce363-b12c-4d5e-b726-a0947f6b30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:07.692772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce363-b12c-4d5e-b726-a0947f6b30f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.695521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce363-b12c-4d5e-b726-a0947f6b30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.697054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce363-b12c-4d5e-b726-a0947f6b30f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.714684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ce363-b12c-4d5e-b726-a0947f6b30f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:07.716427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff27b7-1a0f-4697-a411-e36828a5d120 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:07.720687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ce363-b12c-4d5e-b726-a0947f6b30f4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:07.734089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:07.735044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.735316 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.736303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.736981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:07.738652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:07.767645 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1200/2365] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:07.768944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:07.780422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:07.805673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1166/2366] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:07 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:07.806921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ce363-b12c-4d5e-b726-a0947f6b30f4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:07.939590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ce363-b12c-4d5e-b726-a0947f6b30f4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:07.940378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a37050-e9c8-457a-a45e-7d8e75eea7b9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:07.945545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d31b04-9ee2-425a-89ac-343e7f05d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:07.946250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31b04-9ee2-425a-89ac-343e7f05d200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:07.946684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31b04-9ee2-425a-89ac-343e7f05d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:07.946968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31b04-9ee2-425a-89ac-343e7f05d200 admin admin] PATH_INFO: `/v3/projects/f9f9ec36957b4de9954974f4b9e48b40/users/e9a3eca6c0c64728b778b2dec3bd5e67/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:07.981881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d31b04-9ee2-425a-89ac-343e7f05d200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f9ec36957b4de9954974f4b9e48b40, user_id=e9a3eca6c0c64728b778b2dec3bd5e67, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:07.984801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d31b04-9ee2-425a-89ac-343e7f05d200 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.031168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1167/2367] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:07 2022] PUT /identity/v3/projects/f9f9ec36957b4de9954974f4b9e48b40/users/e9a3eca6c0c64728b778b2dec3bd5e67/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:08.032084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d31b04-9ee2-425a-89ac-343e7f05d200 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.037510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:08.077398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9e018-a28a-4c74-ad4f-07ba3a0c8182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.077940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9e018-a28a-4c74-ad4f-07ba3a0c8182 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.078270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9e018-a28a-4c74-ad4f-07ba3a0c8182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.078575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9e018-a28a-4c74-ad4f-07ba3a0c8182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.090305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9e018-a28a-4c74-ad4f-07ba3a0c8182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.091875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9e018-a28a-4c74-ad4f-07ba3a0c8182 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.108712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1201/2368] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:08.110615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36abb-bc76-4a33-87a0-522830bb3fdb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.110931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36abb-bc76-4a33-87a0-522830bb3fdb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.111180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36abb-bc76-4a33-87a0-522830bb3fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.150760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8bc36abb-bc76-4a33-87a0-522830bb3fdb None None] MFA Rules not processed for user `e9a3eca6c0c64728b778b2dec3bd5e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:08.152936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8bc36abb-bc76-4a33-87a0-522830bb3fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:08.174745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d31b04-9ee2-425a-89ac-343e7f05d200 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:08.183834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24797123-6137-4843-9aea-d9572bfed634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.185525 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24797123-6137-4843-9aea-d9572bfed634 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.185949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24797123-6137-4843-9aea-d9572bfed634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.186468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24797123-6137-4843-9aea-d9572bfed634 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.187431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24797123-6137-4843-9aea-d9572bfed634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.198603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24797123-6137-4843-9aea-d9572bfed634 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.240312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1168/2369] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:08 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:08.245247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24797123-6137-4843-9aea-d9572bfed634 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.266594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24797123-6137-4843-9aea-d9572bfed634 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:08.285211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53b8c0-04fb-4c9a-baf1-5583559d7845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.289599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53b8c0-04fb-4c9a-baf1-5583559d7845 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.290298 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53b8c0-04fb-4c9a-baf1-5583559d7845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.292966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53b8c0-04fb-4c9a-baf1-5583559d7845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.295697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53b8c0-04fb-4c9a-baf1-5583559d7845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.297789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1202/2370] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:08.298849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36abb-bc76-4a33-87a0-522830bb3fdb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.303545 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53b8c0-04fb-4c9a-baf1-5583559d7845 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.319091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36abb-bc76-4a33-87a0-522830bb3fdb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:08.327269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefa3f6-985e-4cdc-af05-714f00b4a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.328066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefa3f6-985e-4cdc-af05-714f00b4a54b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.330321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefa3f6-985e-4cdc-af05-714f00b4a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.330321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefa3f6-985e-4cdc-af05-714f00b4a54b admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.330714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefa3f6-985e-4cdc-af05-714f00b4a54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.334152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefa3f6-985e-4cdc-af05-714f00b4a54b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.341170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1169/2371] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:08.342673 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53b8c0-04fb-4c9a-baf1-5583559d7845 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.362172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53b8c0-04fb-4c9a-baf1-5583559d7845 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:08.371718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007abbbb-223d-4dde-ae5f-0b8940814033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.372735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007abbbb-223d-4dde-ae5f-0b8940814033 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.373506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007abbbb-223d-4dde-ae5f-0b8940814033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.373834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007abbbb-223d-4dde-ae5f-0b8940814033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.375483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007abbbb-223d-4dde-ae5f-0b8940814033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.378738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007abbbb-223d-4dde-ae5f-0b8940814033 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.379172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1203/2372] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:08 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:08.385565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefa3f6-985e-4cdc-af05-714f00b4a54b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.426290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1170/2373] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:08.431038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007abbbb-223d-4dde-ae5f-0b8940814033 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.442941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:08.449850 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007abbbb-223d-4dde-ae5f-0b8940814033 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:08.530534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefa3f6-985e-4cdc-af05-714f00b4a54b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:08.565164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b241-be9f-4a03-967e-a075fab9b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.566316 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b241-be9f-4a03-967e-a075fab9b475 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.566675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b241-be9f-4a03-967e-a075fab9b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.567064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b241-be9f-4a03-967e-a075fab9b475 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.568559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28b241-be9f-4a03-967e-a075fab9b475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.573395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28b241-be9f-4a03-967e-a075fab9b475 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.610022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d786b5-ed74-44be-bb39-948b15cd60b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.611422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d786b5-ed74-44be-bb39-948b15cd60b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.611897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d786b5-ed74-44be-bb39-948b15cd60b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.612375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d786b5-ed74-44be-bb39-948b15cd60b5 admin admin] PATH_INFO: `/v3/projects/8aefb6d31d914fa4b54115609e7c413f/users/26d3883b4b314d65b06099219b3822bd/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.614486 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1204/2374] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:08 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:46:08.619690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b241-be9f-4a03-967e-a075fab9b475 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.633879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b241-be9f-4a03-967e-a075fab9b475 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:08.648719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e7820-90a7-473c-926d-d8a7b2d9e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.648963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d786b5-ed74-44be-bb39-948b15cd60b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aefb6d31d914fa4b54115609e7c413f, user_id=26d3883b4b314d65b06099219b3822bd, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.651913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e7820-90a7-473c-926d-d8a7b2d9e036 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.651913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e7820-90a7-473c-926d-d8a7b2d9e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.651913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e7820-90a7-473c-926d-d8a7b2d9e036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.651913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e7820-90a7-473c-926d-d8a7b2d9e036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.653538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e7820-90a7-473c-926d-d8a7b2d9e036 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.654635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d786b5-ed74-44be-bb39-948b15cd60b5 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.671249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1205/2375] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:08.677963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e7820-90a7-473c-926d-d8a7b2d9e036 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.713960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e7820-90a7-473c-926d-d8a7b2d9e036 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:08.739947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1171/2376] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:08 2022] PUT /identity/v3/projects/8aefb6d31d914fa4b54115609e7c413f/users/26d3883b4b314d65b06099219b3822bd/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:46:08.753708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:08.754594 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c897b4-0668-47cf-8a64-9227aa93d3c6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.756791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c897b4-0668-47cf-8a64-9227aa93d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.757793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c897b4-0668-47cf-8a64-9227aa93d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.832877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:08.834335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:08.834880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:08.835348 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] PATH_INFO: `/v3/projects/1e8857d6c6a743cea2d963bd9f813fd9/users/bfccfba7649b4ce3b100ea1e22600bf7/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:08.835454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-13c897b4-0668-47cf-8a64-9227aa93d3c6 None None] MFA Rules not processed for user `26d3883b4b314d65b06099219b3822bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:08.837186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-13c897b4-0668-47cf-8a64-9227aa93d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:08.863079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8857d6c6a743cea2d963bd9f813fd9, user_id=bfccfba7649b4ce3b100ea1e22600bf7, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:08.866122 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:08.947378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1206/2377] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:08 2022] PUT /identity/v3/projects/1e8857d6c6a743cea2d963bd9f813fd9/users/bfccfba7649b4ce3b100ea1e22600bf7/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:08.947378 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:08.958670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:09.030707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1172/2378] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:09.030707 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c897b4-0668-47cf-8a64-9227aa93d3c6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:09.083449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c897b4-0668-47cf-8a64-9227aa93d3c6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:09.194489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb17614-e41d-4872-843b-78be3d85e783 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:09.201089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:09.201969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:09.202251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:09.202573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] PATH_INFO: `/v3/projects/b766c13c514e4a2d93ba43be8c28b9a8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:09.204497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b766c13c514e4a2d93ba43be8c28b9a8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:09.208831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:09.213381 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90e5a-4fdf-49b9-9e22-45e84094b393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:09.214072 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90e5a-4fdf-49b9-9e22-45e84094b393 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:09.214318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90e5a-4fdf-49b9-9e22-45e84094b393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:09.214565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90e5a-4fdf-49b9-9e22-45e84094b393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:09.216085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d90e5a-4fdf-49b9-9e22-45e84094b393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:09.219265 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d90e5a-4fdf-49b9-9e22-45e84094b393 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:09.241658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1173/2379] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:09.245590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90e5a-4fdf-49b9-9e22-45e84094b393 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:09.271235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90e5a-4fdf-49b9-9e22-45e84094b393 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:09.285153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b672-610e-4af9-aa9c-c027cbeb9041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:09.285773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b672-610e-4af9-aa9c-c027cbeb9041 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:09.286106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b672-610e-4af9-aa9c-c027cbeb9041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:09.286421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b672-610e-4af9-aa9c-c027cbeb9041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:09.290582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b672-610e-4af9-aa9c-c027cbeb9041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:09.294140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389b672-610e-4af9-aa9c-c027cbeb9041 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:09.317810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b766c13c514e4a2d93ba43be8c28b9a8', 'request_id': 'req-de5b83a8-3f97-480c-b87c-1ce893a2000f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:09.322353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:09.326717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b766c13c514e4a2d93ba43be8c28b9a8', 'request_id': 'req-de5b83a8-3f97-480c-b87c-1ce893a2000f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:09.338186 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b766c13c514e4a2d93ba43be8c28b9a8', 'request_id': 'req-de5b83a8-3f97-480c-b87c-1ce893a2000f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:09.354284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1174/2380] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:09 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:09.354284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b672-610e-4af9-aa9c-c027cbeb9041 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:09.364968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] The token cache is being invalidate because project b766c13c514e4a2d93ba43be8c28b9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:09.365242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:09.367566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:09.370080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1207/2381] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:08 2022] DELETE /identity/v3/projects/b766c13c514e4a2d93ba43be8c28b9a8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:09.373401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:09.376670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:09.471551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:09.502889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b672-610e-4af9-aa9c-c027cbeb9041 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:09.524903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40712a62-b122-4983-b12d-3114f5099fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:09.526868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712a62-b122-4983-b12d-3114f5099fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:09.527226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712a62-b122-4983-b12d-3114f5099fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:09.527506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40712a62-b122-4983-b12d-3114f5099fe7 admin admin] PATH_INFO: `/v3/projects/1e8857d6c6a743cea2d963bd9f813fd9/users/bfccfba7649b4ce3b100ea1e22600bf7/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:09.542723 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40712a62-b122-4983-b12d-3114f5099fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8857d6c6a743cea2d963bd9f813fd9, user_id=bfccfba7649b4ce3b100ea1e22600bf7, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:09.555847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40712a62-b122-4983-b12d-3114f5099fe7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:09.571387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b83a8-3f97-480c-b87c-1ce893a2000f admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:09.593359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba2c99-3c57-4685-a39f-21cee558377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:09.593359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2c99-3c57-4685-a39f-21cee558377d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:09.593359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2c99-3c57-4685-a39f-21cee558377d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:09.596964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2c99-3c57-4685-a39f-21cee558377d admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:09.597619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba2c99-3c57-4685-a39f-21cee558377d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:09.601341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1175/2382] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:09 2022] PUT /identity/v3/projects/1e8857d6c6a743cea2d963bd9f813fd9/users/bfccfba7649b4ce3b100ea1e22600bf7/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:09.603862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba2c99-3c57-4685-a39f-21cee558377d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:09.623434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f137ad0-b7a2-41e0-a0ae-1938ddff7bee None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:09.623708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f137ad0-b7a2-41e0-a0ae-1938ddff7bee None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:09.623881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f137ad0-b7a2-41e0-a0ae-1938ddff7bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:09.679625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1208/2383] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:09 2022] POST /identity/v3/users => generated 299 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:09.683315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba2c99-3c57-4685-a39f-21cee558377d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:09.694404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2f137ad0-b7a2-41e0-a0ae-1938ddff7bee None None] MFA Rules not processed for user `bfccfba7649b4ce3b100ea1e22600bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:09.695791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2f137ad0-b7a2-41e0-a0ae-1938ddff7bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:09.705100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba2c99-3c57-4685-a39f-21cee558377d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:09.850975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1176/2384] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:09.866238 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f137ad0-b7a2-41e0-a0ae-1938ddff7bee None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:09.868808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2f137ad0-b7a2-41e0-a0ae-1938ddff7bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:09.928846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aa131-8022-4cbd-9844-23ca072d3f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:09.930206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aa131-8022-4cbd-9844-23ca072d3f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:09.930206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aa131-8022-4cbd-9844-23ca072d3f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:09.931388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aa131-8022-4cbd-9844-23ca072d3f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:09.932370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9aa131-8022-4cbd-9844-23ca072d3f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:09.935592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9aa131-8022-4cbd-9844-23ca072d3f5c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:09.955343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1209/2385] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:09.956458 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aa131-8022-4cbd-9844-23ca072d3f5c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:09.970412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aa131-8022-4cbd-9844-23ca072d3f5c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:09.976596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c1c7-d610-4878-bd69-332ed42579c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:09.977401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c1c7-d610-4878-bd69-332ed42579c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:09.977751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c1c7-d610-4878-bd69-332ed42579c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:09.978096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c1c7-d610-4878-bd69-332ed42579c2 admin admin] PATH_INFO: `/v3/projects/565f740286804407991365b0094e5f2e/users/ff90dcb3743d40188b69f022d1693869/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:09.997974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298c1c7-d610-4878-bd69-332ed42579c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565f740286804407991365b0094e5f2e, user_id=ff90dcb3743d40188b69f022d1693869, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:10.000974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298c1c7-d610-4878-bd69-332ed42579c2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:10.026893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1210/2386] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:09 2022] PUT /identity/v3/projects/565f740286804407991365b0094e5f2e/users/ff90dcb3743d40188b69f022d1693869/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:10.035041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c1c7-d610-4878-bd69-332ed42579c2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:10.062742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f137ad0-b7a2-41e0-a0ae-1938ddff7bee None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:10.179126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:10.227432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c1c7-d610-4878-bd69-332ed42579c2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:10.240329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90121c91-baca-4385-ae97-62a682861061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:10.241048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121c91-baca-4385-ae97-62a682861061 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:10.241320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121c91-baca-4385-ae97-62a682861061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:10.243554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90121c91-baca-4385-ae97-62a682861061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:10.245449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90121c91-baca-4385-ae97-62a682861061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:10.249204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90121c91-baca-4385-ae97-62a682861061 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:10.261012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35793c4-6212-4733-89e4-4c7906d78a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:10.263767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35793c4-6212-4733-89e4-4c7906d78a75 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:10.266022 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35793c4-6212-4733-89e4-4c7906d78a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:10.268025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35793c4-6212-4733-89e4-4c7906d78a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:10.305923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1211/2387] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:10.315273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90121c91-baca-4385-ae97-62a682861061 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:10.331181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90121c91-baca-4385-ae97-62a682861061 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:10.345240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca4be6-7eb6-465a-975a-89daacdfed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:10.345938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4be6-7eb6-465a-975a-89daacdfed13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:10.346218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4be6-7eb6-465a-975a-89daacdfed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:10.346532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4be6-7eb6-465a-975a-89daacdfed13 admin admin] PATH_INFO: `/v3/projects/565f740286804407991365b0094e5f2e/users/ff90dcb3743d40188b69f022d1693869/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:10.351471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca4be6-7eb6-465a-975a-89daacdfed13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565f740286804407991365b0094e5f2e, user_id=ff90dcb3743d40188b69f022d1693869, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:10.354251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca4be6-7eb6-465a-975a-89daacdfed13 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:10.403102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1212/2388] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:10 2022] PUT /identity/v3/projects/565f740286804407991365b0094e5f2e/users/ff90dcb3743d40188b69f022d1693869/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:10.406335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687840e-5ff3-4d42-b4bf-0a130858412b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:10.406980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687840e-5ff3-4d42-b4bf-0a130858412b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:10.407472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687840e-5ff3-4d42-b4bf-0a130858412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:10.443469 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35793c4-6212-4733-89e4-4c7906d78a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:10.454734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35793c4-6212-4733-89e4-4c7906d78a75 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:10.506766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1177/2389] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:10.553965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d687840e-5ff3-4d42-b4bf-0a130858412b None None] MFA Rules not processed for user `ff90dcb3743d40188b69f022d1693869`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:10.557096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d687840e-5ff3-4d42-b4bf-0a130858412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:10.591051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:10.843342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1213/2390] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:10.865411 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35793c4-6212-4733-89e4-4c7906d78a75 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:10.882204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35793c4-6212-4733-89e4-4c7906d78a75 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:11.013255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9884-e070-49f0-9115-14c973d26031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:11.014018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9884-e070-49f0-9115-14c973d26031 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:11.014350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9884-e070-49f0-9115-14c973d26031 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:11.014760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9884-e070-49f0-9115-14c973d26031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:11.017204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c93e9884-e070-49f0-9115-14c973d26031 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:11.120034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e9884-e070-49f0-9115-14c973d26031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:11.121712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e9884-e070-49f0-9115-14c973d26031 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:11.150297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1178/2391] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:11.845632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687840e-5ff3-4d42-b4bf-0a130858412b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:11.847846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d687840e-5ff3-4d42-b4bf-0a130858412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:12.017928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f628ac-9df5-4147-b9be-099da95007c9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:12.018305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f628ac-9df5-4147-b9be-099da95007c9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:12.018777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f628ac-9df5-4147-b9be-099da95007c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:12.058948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687840e-5ff3-4d42-b4bf-0a130858412b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:12.074265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:12.075395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:12.076585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:12.077141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] PATH_INFO: `/v3/users/e9a3eca6c0c64728b778b2dec3bd5e67` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:12.080308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a3eca6c0c64728b778b2dec3bd5e67)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:12.084192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c4f628ac-9df5-4147-b9be-099da95007c9 None None] MFA Rules not processed for user `192a22cb876f4f72b09d5835b479f58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:12.084554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:12.086327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c4f628ac-9df5-4147-b9be-099da95007c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:12.163992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:12.199674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a3eca6c0c64728b778b2dec3bd5e67'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:12.214334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a3eca6c0c64728b778b2dec3bd5e67'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:12.215148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a3eca6c0c64728b778b2dec3bd5e67'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:12.215762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a3eca6c0c64728b778b2dec3bd5e67'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:12.222685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1179/2392] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:12.226204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a3eca6c0c64728b778b2dec3bd5e67'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:12.272446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1214/2393] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:11 2022] DELETE /identity/v3/users/e9a3eca6c0c64728b778b2dec3bd5e67 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:12.273146 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5f6f6-35f8-42c0-ab73-a16e2d49dd9b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:12.273436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5f6f6-35f8-42c0-ab73-a16e2d49dd9b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:12.273709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5f6f6-35f8-42c0-ab73-a16e2d49dd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:12.308212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4ed5f6f6-35f8-42c0-ab73-a16e2d49dd9b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:12.309397 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4ed5f6f6-35f8-42c0-ab73-a16e2d49dd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:12.460491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1180/2394] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:12.471887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:12.473776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:12.537559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:12.583448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304c747-dbe0-4244-a6df-2f96093e7138 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:12.592281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:12.593183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:12.593557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:12.593954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:12.608926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:12.610708 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:12.632885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1215/2395] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:13.223701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5f6f6-35f8-42c0-ab73-a16e2d49dd9b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:13.225185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4ed5f6f6-35f8-42c0-ab73-a16e2d49dd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:13.247685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:13.249262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:13.252136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5f6f6-35f8-42c0-ab73-a16e2d49dd9b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:13.277507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:13.278502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:13.278921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:13.280445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] PATH_INFO: `/v3/projects/f9f9ec36957b4de9954974f4b9e48b40` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:13.281138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f9ec36957b4de9954974f4b9e48b40)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:13.284658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:13.336314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a730f-5318-4678-a405-d44f05373d4c service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:13.340951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:13.342179 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:13.343384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:13.343911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:13.348783 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:13.443255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:13.445560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:13.473011 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1216/2396] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:13.504341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f9ec36957b4de9954974f4b9e48b40', 'request_id': 'req-db95b678-d5d2-4580-b42d-2080bb15f6de'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:13.512829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f9ec36957b4de9954974f4b9e48b40', 'request_id': 'req-db95b678-d5d2-4580-b42d-2080bb15f6de'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:13.524129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f9ec36957b4de9954974f4b9e48b40', 'request_id': 'req-db95b678-d5d2-4580-b42d-2080bb15f6de'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:13.587418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] The token cache is being invalidate because project f9f9ec36957b4de9954974f4b9e48b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:13.587903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:13.609679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:13.631294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1181/2397] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:13 2022] DELETE /identity/v3/projects/f9f9ec36957b4de9954974f4b9e48b40 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:13.636524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:13.666301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5974e-85de-4ced-827e-ba37cbcfde11 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:13.915158 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:13.916184 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:13.916670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:13.917118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] PATH_INFO: `/v3/users/bfccfba7649b4ce3b100ea1e22600bf7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:13.934450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfccfba7649b4ce3b100ea1e22600bf7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:13.934450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:13.984760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:14.036482 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfccfba7649b4ce3b100ea1e22600bf7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:14.054185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfccfba7649b4ce3b100ea1e22600bf7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:14.055000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfccfba7649b4ce3b100ea1e22600bf7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:14.056173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfccfba7649b4ce3b100ea1e22600bf7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:14.071386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfccfba7649b4ce3b100ea1e22600bf7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:14.087734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1217/2398] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:13 2022] DELETE /identity/v3/users/bfccfba7649b4ce3b100ea1e22600bf7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:46:15.078251 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:15.088282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:15.498718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95b678-d5d2-4580-b42d-2080bb15f6de admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:15.574261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:15.610427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:15.615795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:15.736443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c018e-f598-4965-b093-da954157f894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:15.737679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c018e-f598-4965-b093-da954157f894 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:15.738156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c018e-f598-4965-b093-da954157f894 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:15.738661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c018e-f598-4965-b093-da954157f894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:15.741875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2a5c018e-f598-4965-b093-da954157f894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:15.749514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976d01-83a7-4fc1-b300-03e60131fc4e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:15.755989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:15.756945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:15.757409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:15.757928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] PATH_INFO: `/v3/projects/1e8857d6c6a743cea2d963bd9f813fd9` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:15.759392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8857d6c6a743cea2d963bd9f813fd9)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:15.761647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:15.860235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8857d6c6a743cea2d963bd9f813fd9', 'request_id': 'req-e5c51670-e233-482d-af5f-acc9e68105e2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:15.876509 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8857d6c6a743cea2d963bd9f813fd9', 'request_id': 'req-e5c51670-e233-482d-af5f-acc9e68105e2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:15.885173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8857d6c6a743cea2d963bd9f813fd9', 'request_id': 'req-e5c51670-e233-482d-af5f-acc9e68105e2'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:15.893373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c018e-f598-4965-b093-da954157f894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:15.895609 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c018e-f598-4965-b093-da954157f894 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:15.909741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] The token cache is being invalidate because project 1e8857d6c6a743cea2d963bd9f813fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:15.910093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:15.910734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e5c51670-e233-482d-af5f-acc9e68105e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:15.912762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1218/2399] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:15 2022] DELETE /identity/v3/projects/1e8857d6c6a743cea2d963bd9f813fd9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:46:15.914473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1182/2400] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 837 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:15.925648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a422b6-ed51-457b-ae87-60cfd2e9c83c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:15.925930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a422b6-ed51-457b-ae87-60cfd2e9c83c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:15.926204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a422b6-ed51-457b-ae87-60cfd2e9c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:15.979673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-18a422b6-ed51-457b-ae87-60cfd2e9c83c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:15.981836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-18a422b6-ed51-457b-ae87-60cfd2e9c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:16.036960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:16.126444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1219/2401] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:16.135824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020da9-fb3f-431f-9b41-631c08be35ee None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:16.136425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020da9-fb3f-431f-9b41-631c08be35ee None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:16.136761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020da9-fb3f-431f-9b41-631c08be35ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:16.226300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ce020da9-fb3f-431f-9b41-631c08be35ee None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:16.237423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ce020da9-fb3f-431f-9b41-631c08be35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:16.270328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1183/2402] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:16.272868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a422b6-ed51-457b-ae87-60cfd2e9c83c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:16.315454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a422b6-ed51-457b-ae87-60cfd2e9c83c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:16.337826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:16.339564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:16.340361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:16.341096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:16.342704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:46:16.353716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:16.357406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:16.438423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1220/2403] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:46:16.440685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020da9-fb3f-431f-9b41-631c08be35ee None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:16.477550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020da9-fb3f-431f-9b41-631c08be35ee None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:16.487369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731f2d-92ed-49f5-988c-a15df735752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:16.490841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731f2d-92ed-49f5-988c-a15df735752a admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:16.491864 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731f2d-92ed-49f5-988c-a15df735752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:16.492351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731f2d-92ed-49f5-988c-a15df735752a admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:16.494788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a731f2d-92ed-49f5-988c-a15df735752a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:16.498203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a731f2d-92ed-49f5-988c-a15df735752a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:16.570561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1184/2404] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:16 2022] POST /identity/v3/projects => generated 361 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:16.575946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:16.598187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb794e49-d0ef-494e-8c8d-c52fc3ca1513 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:16.802795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44c9a3-56bc-4189-bd3c-d5941021d2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:16.804269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44c9a3-56bc-4189-bd3c-d5941021d2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:16.804735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44c9a3-56bc-4189-bd3c-d5941021d2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:16.805338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44c9a3-56bc-4189-bd3c-d5941021d2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:16.806319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44c9a3-56bc-4189-bd3c-d5941021d2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:16.809676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44c9a3-56bc-4189-bd3c-d5941021d2d1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:16.862900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1221/2405] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:16 2022] POST /identity/v3/users => generated 281 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:16.865457 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731f2d-92ed-49f5-988c-a15df735752a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:16.884827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731f2d-92ed-49f5-988c-a15df735752a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:16.905633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190453b-2a22-44cd-aa0b-464015791ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:16.907902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190453b-2a22-44cd-aa0b-464015791ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:16.907902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190453b-2a22-44cd-aa0b-464015791ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:16.907902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190453b-2a22-44cd-aa0b-464015791ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:16.913550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190453b-2a22-44cd-aa0b-464015791ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:16.913550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190453b-2a22-44cd-aa0b-464015791ad0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:16.946441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1185/2406] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:46:16.950240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44c9a3-56bc-4189-bd3c-d5941021d2d1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:16.977542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44c9a3-56bc-4189-bd3c-d5941021d2d1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:17.025445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f06b95-e660-4622-a59f-e49d059f892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:17.026472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06b95-e660-4622-a59f-e49d059f892d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:17.026941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06b95-e660-4622-a59f-e49d059f892d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:17.027414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06b95-e660-4622-a59f-e49d059f892d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:17.035180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f06b95-e660-4622-a59f-e49d059f892d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:17.044368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f06b95-e660-4622-a59f-e49d059f892d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:17.142857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1222/2407] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:17.145543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190453b-2a22-44cd-aa0b-464015791ad0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:17.184049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190453b-2a22-44cd-aa0b-464015791ad0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:17.208925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:17.210420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:17.211059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:17.211622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] PATH_INFO: `/v3/projects/818c5b56685a435ba1a6f594258d40a4/users/5b4da0423f344c1dbf1df408cbc8624a/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:17.251884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=818c5b56685a435ba1a6f594258d40a4, user_id=5b4da0423f344c1dbf1df408cbc8624a, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:17.263196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:17.322436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1186/2408] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:17 2022] PUT /identity/v3/projects/818c5b56685a435ba1a6f594258d40a4/users/5b4da0423f344c1dbf1df408cbc8624a/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:17.331701 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c757a74-40b3-4bd9-b282-23ca89c0bd24 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:17.332652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c757a74-40b3-4bd9-b282-23ca89c0bd24 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:17.333283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c757a74-40b3-4bd9-b282-23ca89c0bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:17.395966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5c757a74-40b3-4bd9-b282-23ca89c0bd24 None None] MFA Rules not processed for user `5b4da0423f344c1dbf1df408cbc8624a`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:17.399183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5c757a74-40b3-4bd9-b282-23ca89c0bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:17.694321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1223/2409] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:17.797766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:17.804408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:18.021547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fbc3f-fe30-4ed0-bda0-9112d210d94e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:18.032852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d314bd-4c0a-4590-8277-95d876c030d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:18.033981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d314bd-4c0a-4590-8277-95d876c030d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:18.034450 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d314bd-4c0a-4590-8277-95d876c030d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:18.034946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d314bd-4c0a-4590-8277-95d876c030d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:18.049635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d314bd-4c0a-4590-8277-95d876c030d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:18.052344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d314bd-4c0a-4590-8277-95d876c030d5 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:18.089480 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1187/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:18.098114 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c757a74-40b3-4bd9-b282-23ca89c0bd24 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:18.147134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:18.194791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c757a74-40b3-4bd9-b282-23ca89c0bd24 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:18.219326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:18.220102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:18.220377 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:18.220646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] PATH_INFO: `/v3/users/5b4da0423f344c1dbf1df408cbc8624a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:18.222921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4da0423f344c1dbf1df408cbc8624a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:18.225733 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:18.368884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4da0423f344c1dbf1df408cbc8624a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:18.408461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4da0423f344c1dbf1df408cbc8624a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:18.424648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4da0423f344c1dbf1df408cbc8624a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:18.435478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4da0423f344c1dbf1df408cbc8624a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:18.538459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4da0423f344c1dbf1df408cbc8624a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:18.614471 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1224/2411] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:18 2022] DELETE /identity/v3/users/5b4da0423f344c1dbf1df408cbc8624a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:18.620125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacdcb1-9978-4b8c-b83a-46f225550cd5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:18.621270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacdcb1-9978-4b8c-b83a-46f225550cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:18.621741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacdcb1-9978-4b8c-b83a-46f225550cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:18.638538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:18.668553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-afacdcb1-9978-4b8c-b83a-46f225550cd5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:18.672485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-afacdcb1-9978-4b8c-b83a-46f225550cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:18.774547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1188/2412] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:18.790601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:18.792059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:18.999554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d55b3-55f2-451b-99dc-74f3dd16e7d9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:19.007531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b47e7-0e54-4f56-877d-f8c76d88fc0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:19.008717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b47e7-0e54-4f56-877d-f8c76d88fc0e service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:19.009591 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b47e7-0e54-4f56-877d-f8c76d88fc0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:19.011461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b47e7-0e54-4f56-877d-f8c76d88fc0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:19.030443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b47e7-0e54-4f56-877d-f8c76d88fc0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:19.034089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b47e7-0e54-4f56-877d-f8c76d88fc0e service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:19.068064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1225/2413] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:19.967243 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacdcb1-9978-4b8c-b83a-46f225550cd5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:19.970089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-afacdcb1-9978-4b8c-b83a-46f225550cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:20.025926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacdcb1-9978-4b8c-b83a-46f225550cd5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:20.046119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:20.047326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:20.054778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:20.055383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] PATH_INFO: `/v3/projects/818c5b56685a435ba1a6f594258d40a4` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:20.060561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818c5b56685a435ba1a6f594258d40a4)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:20.064361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:20.242843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818c5b56685a435ba1a6f594258d40a4', 'request_id': 'req-4b3fa834-d09d-4692-a826-166560f3a321'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:20.252930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818c5b56685a435ba1a6f594258d40a4', 'request_id': 'req-4b3fa834-d09d-4692-a826-166560f3a321'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:20.265776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818c5b56685a435ba1a6f594258d40a4', 'request_id': 'req-4b3fa834-d09d-4692-a826-166560f3a321'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:20.283356 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] The token cache is being invalidate because project 818c5b56685a435ba1a6f594258d40a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:20.284006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:20.284985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-4b3fa834-d09d-4692-a826-166560f3a321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:20.289306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1189/2414] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:19 2022] DELETE /identity/v3/projects/818c5b56685a435ba1a6f594258d40a4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:20.293795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d824-5ac2-4d59-839e-c9ef7e706a15 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:20.294820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d824-5ac2-4d59-839e-c9ef7e706a15 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:20.295306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d824-5ac2-4d59-839e-c9ef7e706a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:20.319884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-df43d824-5ac2-4d59-839e-c9ef7e706a15 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:20.321558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-df43d824-5ac2-4d59-839e-c9ef7e706a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:20.382702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:20.402008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1226/2415] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:20.411096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130aa2-e0e2-4ac7-893a-f2e0c8715df7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:20.411454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130aa2-e0e2-4ac7-893a-f2e0c8715df7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:20.411617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130aa2-e0e2-4ac7-893a-f2e0c8715df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:20.438898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b0130aa2-e0e2-4ac7-893a-f2e0c8715df7 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:20.440260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b0130aa2-e0e2-4ac7-893a-f2e0c8715df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:20.450880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1190/2416] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:20.455062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43d824-5ac2-4d59-839e-c9ef7e706a15 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:20.465833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43d824-5ac2-4d59-839e-c9ef7e706a15 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:20.471796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:20.472527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:20.472843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:20.473663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:20.474561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:46:20.474935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:20.476876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:20.512007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0130aa2-e0e2-4ac7-893a-f2e0c8715df7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:20.518977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1227/2417] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:46:20.527589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0130aa2-e0e2-4ac7-893a-f2e0c8715df7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:20.540048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:20.541323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:20.541915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:20.542565 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:20.544380 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:20.546443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:20.617108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1191/2418] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:20 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:20.623714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:20.647126 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b86a-4898-4b7b-b2a1-9ebd4d73ca55 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:20.830566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686bc0-7bb3-4c58-a71f-7174319e9cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:20.831223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686bc0-7bb3-4c58-a71f-7174319e9cdd admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:20.831501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686bc0-7bb3-4c58-a71f-7174319e9cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:20.832443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686bc0-7bb3-4c58-a71f-7174319e9cdd admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:20.832443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686bc0-7bb3-4c58-a71f-7174319e9cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:20.834908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686bc0-7bb3-4c58-a71f-7174319e9cdd admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:20.884416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:20.886362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:20.894437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1228/2419] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:20 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:20.901642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686bc0-7bb3-4c58-a71f-7174319e9cdd admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:20.925354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686bc0-7bb3-4c58-a71f-7174319e9cdd admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:20.926715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c624c8-d270-493d-93f6-536b312ddf92 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:20.934954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0dd58-10b5-489a-9503-2eacc3c8d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:20.936152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0dd58-10b5-489a-9503-2eacc3c8d4ed admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:20.936765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0dd58-10b5-489a-9503-2eacc3c8d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:20.937357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0dd58-10b5-489a-9503-2eacc3c8d4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:20.939062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0dd58-10b5-489a-9503-2eacc3c8d4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:20.941122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:20.941800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:20.942158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:20.942471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] PATH_INFO: `/v3/users/73e0c7c07e87472898f9f9269ad897d8` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:20.942647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0dd58-10b5-489a-9503-2eacc3c8d4ed admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:20.949708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e0c7c07e87472898f9f9269ad897d8)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:20.951860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:20.966481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1229/2420] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:20.972353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0dd58-10b5-489a-9503-2eacc3c8d4ed admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:21.001233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0dd58-10b5-489a-9503-2eacc3c8d4ed admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:21.013264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48132c0c-094c-445a-89fc-ea3d3b6c24e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:21.014923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48132c0c-094c-445a-89fc-ea3d3b6c24e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:21.015505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48132c0c-094c-445a-89fc-ea3d3b6c24e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:21.016081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48132c0c-094c-445a-89fc-ea3d3b6c24e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:21.017321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48132c0c-094c-445a-89fc-ea3d3b6c24e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:21.022265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48132c0c-094c-445a-89fc-ea3d3b6c24e2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:21.097511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1230/2421] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:21.115901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48132c0c-094c-445a-89fc-ea3d3b6c24e2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:21.132532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e0c7c07e87472898f9f9269ad897d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:21.142145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:21.145494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48132c0c-094c-445a-89fc-ea3d3b6c24e2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:21.155144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e0c7c07e87472898f9f9269ad897d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:21.157411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992e363-a61b-4f53-8892-f3d738586f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:21.158613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992e363-a61b-4f53-8892-f3d738586f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:21.159496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992e363-a61b-4f53-8892-f3d738586f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:21.159838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992e363-a61b-4f53-8892-f3d738586f16 admin admin] PATH_INFO: `/v3/projects/8a4077ab228649078e8236d8d2cc75b2/users/88a5944624ab4eb993ee849aac0d3829/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:21.170816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e0c7c07e87472898f9f9269ad897d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:21.173382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e0c7c07e87472898f9f9269ad897d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:21.174120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-807a2777-7788-479f-ab38-3c9c0a4f1f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e0c7c07e87472898f9f9269ad897d8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:21.202872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1192/2422] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:20 2022] DELETE /identity/v3/users/73e0c7c07e87472898f9f9269ad897d8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:46:21.205086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992e363-a61b-4f53-8892-f3d738586f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4077ab228649078e8236d8d2cc75b2, user_id=88a5944624ab4eb993ee849aac0d3829, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:21.208450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992e363-a61b-4f53-8892-f3d738586f16 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:21.211363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaab17-7709-4484-b809-14410b58b85e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:21.214303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaab17-7709-4484-b809-14410b58b85e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:21.215271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaab17-7709-4484-b809-14410b58b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:21.242912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1231/2423] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:21 2022] PUT /identity/v3/projects/8a4077ab228649078e8236d8d2cc75b2/users/88a5944624ab4eb993ee849aac0d3829/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:21.261453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7daa0d-d981-4b89-80e4-969053408866 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:21.262036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7daa0d-d981-4b89-80e4-969053408866 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:21.265663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7daa0d-d981-4b89-80e4-969053408866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:21.274789 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2aaaab17-7709-4484-b809-14410b58b85e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:21.277948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2aaaab17-7709-4484-b809-14410b58b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:21.336475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-df7daa0d-d981-4b89-80e4-969053408866 None None] MFA Rules not processed for user `88a5944624ab4eb993ee849aac0d3829`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:21.338234 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-df7daa0d-d981-4b89-80e4-969053408866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:21.370966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1193/2424] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:21.383882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaab17-7709-4484-b809-14410b58b85e None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:21.386680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2aaaab17-7709-4484-b809-14410b58b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:21.461232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1232/2425] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:21.529837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaab17-7709-4484-b809-14410b58b85e None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:21.544153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d124e2-ef1b-4163-a5d5-c419bf295b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:21.547734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d124e2-ef1b-4163-a5d5-c419bf295b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:21.548248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d124e2-ef1b-4163-a5d5-c419bf295b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:21.548763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d124e2-ef1b-4163-a5d5-c419bf295b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:21.598870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d124e2-ef1b-4163-a5d5-c419bf295b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:21.601479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d124e2-ef1b-4163-a5d5-c419bf295b94 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:21.617320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1194/2426] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:22.144252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7daa0d-d981-4b89-80e4-969053408866 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:22.153261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-df7daa0d-d981-4b89-80e4-969053408866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:22.189331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7daa0d-d981-4b89-80e4-969053408866 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:22.203460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:22.204187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:22.204475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:22.204764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] PATH_INFO: `/v3/projects/fa1629cc99304a78834f18559664d266` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:22.206262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1629cc99304a78834f18559664d266)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:22.210280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:22.222367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:22.299228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1629cc99304a78834f18559664d266', 'request_id': 'req-c274e579-e969-4891-86cb-ec5792349e7c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.314124 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1629cc99304a78834f18559664d266', 'request_id': 'req-c274e579-e969-4891-86cb-ec5792349e7c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.335216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1629cc99304a78834f18559664d266', 'request_id': 'req-c274e579-e969-4891-86cb-ec5792349e7c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.357570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] The token cache is being invalidate because project fa1629cc99304a78834f18559664d266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:22.358137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.359099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.361950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1233/2427] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:22 2022] DELETE /identity/v3/projects/fa1629cc99304a78834f18559664d266 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:22.367365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d124e2-ef1b-4163-a5d5-c419bf295b94 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:22.384236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d124e2-ef1b-4163-a5d5-c419bf295b94 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:22.473766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:22.474494 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:22.474785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:22.475066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] PATH_INFO: `/v3/users/26d3883b4b314d65b06099219b3822bd` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:22.476498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d3883b4b314d65b06099219b3822bd)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:22.479003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:22.499073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:22.567598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d3883b4b314d65b06099219b3822bd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.591952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d3883b4b314d65b06099219b3822bd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.622988 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d3883b4b314d65b06099219b3822bd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.623784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d3883b4b314d65b06099219b3822bd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.624426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d3883b4b314d65b06099219b3822bd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:22.654766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1195/2428] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:22 2022] DELETE /identity/v3/users/26d3883b4b314d65b06099219b3822bd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:23.300376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:23.303602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:23.340449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274e579-e969-4891-86cb-ec5792349e7c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:23.429005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:23.429842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:23.430249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:23.430615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] PATH_INFO: `/v3/projects/8aefb6d31d914fa4b54115609e7c413f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:23.432083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aefb6d31d914fa4b54115609e7c413f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:23.434214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:23.616710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aefb6d31d914fa4b54115609e7c413f', 'request_id': 'req-0e075d9e-63ce-4863-b283-8eea092009c7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.633861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aefb6d31d914fa4b54115609e7c413f', 'request_id': 'req-0e075d9e-63ce-4863-b283-8eea092009c7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.655018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aefb6d31d914fa4b54115609e7c413f', 'request_id': 'req-0e075d9e-63ce-4863-b283-8eea092009c7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.680434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] The token cache is being invalidate because project 8aefb6d31d914fa4b54115609e7c413f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:23.681351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.682369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.685475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1234/2429] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:23 2022] DELETE /identity/v3/projects/8aefb6d31d914fa4b54115609e7c413f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:23.688775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:23.690819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:23.717338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087fed6-6468-46a6-99bb-ef4d45e76115 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:23.881246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:23.882595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:23.883183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:23.883752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] PATH_INFO: `/v3/users/ff90dcb3743d40188b69f022d1693869` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:23.885802 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff90dcb3743d40188b69f022d1693869)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:23.889156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:23.953275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff90dcb3743d40188b69f022d1693869'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.974404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff90dcb3743d40188b69f022d1693869'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.986680 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff90dcb3743d40188b69f022d1693869'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.987726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff90dcb3743d40188b69f022d1693869'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:23.990191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba9c02bf-2076-4459-b5be-24b52b65853b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff90dcb3743d40188b69f022d1693869'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:24.023617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1196/2430] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:23 2022] DELETE /identity/v3/users/ff90dcb3743d40188b69f022d1693869 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:24.575149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:24.576825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:24.591929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075d9e-63ce-4863-b283-8eea092009c7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:24.625929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:24.715541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:24.716710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:24.716975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:24.717253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] PATH_INFO: `/v3/projects/565f740286804407991365b0094e5f2e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:24.718753 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565f740286804407991365b0094e5f2e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:24.720744 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:24.807668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565f740286804407991365b0094e5f2e', 'request_id': 'req-5419a899-ac4e-450f-b1d7-f4c00e41d393'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:24.818959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565f740286804407991365b0094e5f2e', 'request_id': 'req-5419a899-ac4e-450f-b1d7-f4c00e41d393'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:24.832964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565f740286804407991365b0094e5f2e', 'request_id': 'req-5419a899-ac4e-450f-b1d7-f4c00e41d393'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:24.870667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] The token cache is being invalidate because project 565f740286804407991365b0094e5f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:24.870965 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:24.871779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5419a899-ac4e-450f-b1d7-f4c00e41d393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:24.873527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1235/2431] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:24 2022] DELETE /identity/v3/projects/565f740286804407991365b0094e5f2e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:24.878906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f651-ff44-4a19-a161-30278e6158c8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:24.879607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f651-ff44-4a19-a161-30278e6158c8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:24.879607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f651-ff44-4a19-a161-30278e6158c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:24.901903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f336f651-ff44-4a19-a161-30278e6158c8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:24.903205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f336f651-ff44-4a19-a161-30278e6158c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:24.916843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:25.000377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1197/2432] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:25.011625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd666a-3e7c-406d-bdf2-3c94648da743 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.012143 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd666a-3e7c-406d-bdf2-3c94648da743 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.012919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd666a-3e7c-406d-bdf2-3c94648da743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.048597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2cfd666a-3e7c-406d-bdf2-3c94648da743 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:25.049962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2cfd666a-3e7c-406d-bdf2-3c94648da743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:25.068152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1236/2433] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:25.074466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336f651-ff44-4a19-a161-30278e6158c8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:25.084445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd666a-3e7c-406d-bdf2-3c94648da743 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:25.087572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2cfd666a-3e7c-406d-bdf2-3c94648da743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:25.091631 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336f651-ff44-4a19-a161-30278e6158c8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:25.098570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:25.099941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.100683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.101160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.102092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:46:25.102430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:25.104210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:25.125719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1198/2434] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:46:25.127264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:25.144422 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4726fc-3da9-4208-8de6-d51f6600c4fe admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:25.152068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375a795-99db-4637-a9f2-970c9c027bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:25.152914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375a795-99db-4637-a9f2-970c9c027bff admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.153363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375a795-99db-4637-a9f2-970c9c027bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.153787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375a795-99db-4637-a9f2-970c9c027bff admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.155445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375a795-99db-4637-a9f2-970c9c027bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:25.158948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375a795-99db-4637-a9f2-970c9c027bff admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:25.199455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd666a-3e7c-406d-bdf2-3c94648da743 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:25.204336 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1199/2435] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:25 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:46:25.205181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89357dc69c8f456580613061f2cbef07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:25.206239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.206807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.207329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.210628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375a795-99db-4637-a9f2-970c9c027bff admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:25.211610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:25.305643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:25.308055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:25.315791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:25.331423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1237/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:46:25.347095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375a795-99db-4637-a9f2-970c9c027bff admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:25.353559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed310a4-17df-43d9-b914-390f4533f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:25.354696 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed310a4-17df-43d9-b914-390f4533f7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.355232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed310a4-17df-43d9-b914-390f4533f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.356363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed310a4-17df-43d9-b914-390f4533f7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.357016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed310a4-17df-43d9-b914-390f4533f7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:25.362464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed310a4-17df-43d9-b914-390f4533f7a4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:25.410471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1200/2437] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:25 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:25.415874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:25.439153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659ecf-e061-4a51-be76-effe13e135d6 service glance] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:25.459376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdb01d-da27-49ec-be9d-dfb78cd1cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:25.460413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdb01d-da27-49ec-be9d-dfb78cd1cfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.461047 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdb01d-da27-49ec-be9d-dfb78cd1cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.461886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdb01d-da27-49ec-be9d-dfb78cd1cfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.467020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdb01d-da27-49ec-be9d-dfb78cd1cfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:25.469383 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdb01d-da27-49ec-be9d-dfb78cd1cfaf admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:25.486447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1238/2438] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:25.490963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed310a4-17df-43d9-b914-390f4533f7a4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:25.514947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed310a4-17df-43d9-b914-390f4533f7a4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:25.522287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9319524-aad2-4e7c-81c3-1e5e2d376187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:25.523559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319524-aad2-4e7c-81c3-1e5e2d376187 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.524015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319524-aad2-4e7c-81c3-1e5e2d376187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.524448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319524-aad2-4e7c-81c3-1e5e2d376187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.525747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9319524-aad2-4e7c-81c3-1e5e2d376187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:25.530170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9319524-aad2-4e7c-81c3-1e5e2d376187 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:25.545391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1201/2439] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:25.550323 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdb01d-da27-49ec-be9d-dfb78cd1cfaf admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:25.567631 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdb01d-da27-49ec-be9d-dfb78cd1cfaf admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:25.576599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:25.577743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.578227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.578746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] PATH_INFO: `/v3/projects/361e41f6b3bd41ba86e8bf01d332b924/users/9406b65614734a5f86565044167bbb95/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.608399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361e41f6b3bd41ba86e8bf01d332b924, user_id=9406b65614734a5f86565044167bbb95, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:25.614188 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:25.645976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1239/2440] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:25 2022] PUT /identity/v3/projects/361e41f6b3bd41ba86e8bf01d332b924/users/9406b65614734a5f86565044167bbb95/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:46:25.652068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6116e71-7fc1-4d65-964c-b6b4f07b141f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.652471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6116e71-7fc1-4d65-964c-b6b4f07b141f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.652816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6116e71-7fc1-4d65-964c-b6b4f07b141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.701098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b6116e71-7fc1-4d65-964c-b6b4f07b141f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:25.702641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b6116e71-7fc1-4d65-964c-b6b4f07b141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:25.792028 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:25.805178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1202/2441] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:25.815371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:25.817362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:25.949214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3bad5-2854-40c9-9ced-76ebbbb96426 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:25.954982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:25.955619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:25.955935 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:25.956261 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:25.973687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:25.977606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:25.994755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1240/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:46:27.240964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b5dae-7e01-453a-920f-a019bb92aaeb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:27.241827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b5dae-7e01-453a-920f-a019bb92aaeb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:27.241827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b5dae-7e01-453a-920f-a019bb92aaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:27.277017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3d0b5dae-7e01-453a-920f-a019bb92aaeb None None] MFA Rules not processed for user `9406b65614734a5f86565044167bbb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:27.278247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3d0b5dae-7e01-453a-920f-a019bb92aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:27.395386 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1203/2443] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:27.408135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:27.411761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:27.543769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c1490-95d3-4ecf-b5fb-1ac2737d1aa8 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:27.548779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb379bf-0b7a-4f9d-bfa8-4bd791936111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:27.549517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb379bf-0b7a-4f9d-bfa8-4bd791936111 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:27.549757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb379bf-0b7a-4f9d-bfa8-4bd791936111 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:27.550010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb379bf-0b7a-4f9d-bfa8-4bd791936111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:27.562049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb379bf-0b7a-4f9d-bfa8-4bd791936111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:27.563905 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb379bf-0b7a-4f9d-bfa8-4bd791936111 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:27.583130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1241/2444] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:29.092717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964f646-e8ff-4f41-83a8-b3be533703a4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:29.093579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964f646-e8ff-4f41-83a8-b3be533703a4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:29.093691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964f646-e8ff-4f41-83a8-b3be533703a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:29.125464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-1964f646-e8ff-4f41-83a8-b3be533703a4 None None] MFA Rules not processed for user `9406b65614734a5f86565044167bbb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:29.127549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1964f646-e8ff-4f41-83a8-b3be533703a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:29.137934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1204/2445] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:30.361285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3312e-df37-4d8c-82a7-303b5882f912 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:30.362346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3312e-df37-4d8c-82a7-303b5882f912 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:30.363038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3312e-df37-4d8c-82a7-303b5882f912 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:30.365138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1242/2446] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:46:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:46:30.371693 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a8f2-2389-4631-a532-da7a3e499c44 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:30.372399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a8f2-2389-4631-a532-da7a3e499c44 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:30.372399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57a8f2-2389-4631-a532-da7a3e499c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:30.399705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9e57a8f2-2389-4631-a532-da7a3e499c44 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:30.407122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9e57a8f2-2389-4631-a532-da7a3e499c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:30.602941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1205/2447] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:46:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:36.027917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3312e-df37-4d8c-82a7-303b5882f912 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:36.030087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-26c3312e-df37-4d8c-82a7-303b5882f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:36.094386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3312e-df37-4d8c-82a7-303b5882f912 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:36.098487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b30e62-512c-4b45-a306-810ced31660c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89357dc69c8f456580613061f2cbef07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:36.099116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30e62-512c-4b45-a306-810ced31660c service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:36.099416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30e62-512c-4b45-a306-810ced31660c service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:36.099680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b30e62-512c-4b45-a306-810ced31660c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:36.110841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30e62-512c-4b45-a306-810ced31660c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:36.112319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b30e62-512c-4b45-a306-810ced31660c service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:36.123884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1243/2448] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:36.205198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8c51-3e20-4082-aecf-facac0754e59 None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:36.205759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8c51-3e20-4082-aecf-facac0754e59 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:36.205759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8c51-3e20-4082-aecf-facac0754e59 None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:36.207219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1206/2449] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:46:36.213307 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616f5b2-5e6d-4a37-8b01-56ea8ab8c046 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:36.213605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616f5b2-5e6d-4a37-8b01-56ea8ab8c046 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:36.213925 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616f5b2-5e6d-4a37-8b01-56ea8ab8c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:36.236604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-6616f5b2-5e6d-4a37-8b01-56ea8ab8c046 None None] MFA Rules not processed for user `6b24f12951bd4220afad25f23f566f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:36.237823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6616f5b2-5e6d-4a37-8b01-56ea8ab8c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:36.249951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1244/2450] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:46:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:36.264375 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf8c51-3e20-4082-aecf-facac0754e59 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:36.266430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e5cf8c51-3e20-4082-aecf-facac0754e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:36.294106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf8c51-3e20-4082-aecf-facac0754e59 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:36.298306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a783b70-e534-4e48-b349-fa32bf9dd192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:36.298973 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783b70-e534-4e48-b349-fa32bf9dd192 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:36.299232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783b70-e534-4e48-b349-fa32bf9dd192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:36.299493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783b70-e534-4e48-b349-fa32bf9dd192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:36.308503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a783b70-e534-4e48-b349-fa32bf9dd192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:36.309957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a783b70-e534-4e48-b349-fa32bf9dd192 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:36.319540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1207/2451] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:36.416959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae323173-137f-4af4-a9cf-cf26f85560b7 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:36.417308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae323173-137f-4af4-a9cf-cf26f85560b7 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:36.417527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae323173-137f-4af4-a9cf-cf26f85560b7 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:36.419094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1245/2452] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:46:36.425867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a904c9-90ac-4f4a-850c-174b18525c69 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:36.426279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a904c9-90ac-4f4a-850c-174b18525c69 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:36.426794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a904c9-90ac-4f4a-850c-174b18525c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:36.452780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-56a904c9-90ac-4f4a-850c-174b18525c69 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:36.454158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-56a904c9-90ac-4f4a-850c-174b18525c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:36.465474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1208/2453] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:46:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:36.485281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae323173-137f-4af4-a9cf-cf26f85560b7 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:36.501787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae323173-137f-4af4-a9cf-cf26f85560b7 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:36.508841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:36.509476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:36.509741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:36.510022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:36.518580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:36.524945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:36.528337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:36.542136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1246/2454] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:41.325897 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975f6a-87a8-431a-8d89-c919e6256416 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:41.326591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975f6a-87a8-431a-8d89-c919e6256416 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:41.326591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975f6a-87a8-431a-8d89-c919e6256416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:41.351270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-61975f6a-87a8-431a-8d89-c919e6256416 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:41.352612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-61975f6a-87a8-431a-8d89-c919e6256416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:41.447728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:41.449871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1209/2455] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:46:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:41.463972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:41.465626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:41.556102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f7669-cc46-43f1-92d1-c535cb4ba0f8 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:41.562416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55230c-6f27-49b3-bad2-77f9ca779438 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:41.563171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55230c-6f27-49b3-bad2-77f9ca779438 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:41.563510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55230c-6f27-49b3-bad2-77f9ca779438 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:41.563846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55230c-6f27-49b3-bad2-77f9ca779438 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:41.581912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55230c-6f27-49b3-bad2-77f9ca779438 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:41.584211 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55230c-6f27-49b3-bad2-77f9ca779438 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:41.593608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1247/2456] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:46:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:46:51.454521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:51.590281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=35 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:56.207879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61975f6a-87a8-431a-8d89-c919e6256416 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:56.210104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-61975f6a-87a8-431a-8d89-c919e6256416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:56.226176 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61975f6a-87a8-431a-8d89-c919e6256416 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:56.232421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:56.233081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:56.233362 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:56.233629 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] PATH_INFO: `/v3/users/88a5944624ab4eb993ee849aac0d3829` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:56.234913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a5944624ab4eb993ee849aac0d3829)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:56.236884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:56.297134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a5944624ab4eb993ee849aac0d3829'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.311836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a5944624ab4eb993ee849aac0d3829'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.319297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a5944624ab4eb993ee849aac0d3829'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.320045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a5944624ab4eb993ee849aac0d3829'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.320674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a5944624ab4eb993ee849aac0d3829'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.335855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1210/2457] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:46:56 2022] DELETE /identity/v3/users/88a5944624ab4eb993ee849aac0d3829 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:56.340883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1b03f-bf44-48b8-a76f-cac1e932f7b8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:56.341961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1b03f-bf44-48b8-a76f-cac1e932f7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:56.342692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1b03f-bf44-48b8-a76f-cac1e932f7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:56.363012 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a8d1b03f-bf44-48b8-a76f-cac1e932f7b8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:56.364192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a8d1b03f-bf44-48b8-a76f-cac1e932f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:56.427937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1248/2458] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:56.438459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:56.439963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:56.505667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b5e6-c02a-49b5-ac27-27b019f1e9a0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:56.509476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da0729-56e6-437c-88f7-ed75fa43c82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:56.510098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0729-56e6-437c-88f7-ed75fa43c82f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:56.510401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0729-56e6-437c-88f7-ed75fa43c82f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:56.510668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0729-56e6-437c-88f7-ed75fa43c82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:56.520435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da0729-56e6-437c-88f7-ed75fa43c82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:56.521949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da0729-56e6-437c-88f7-ed75fa43c82f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:56.534658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1211/2459] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:56.850989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1b03f-bf44-48b8-a76f-cac1e932f7b8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:56.853397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a8d1b03f-bf44-48b8-a76f-cac1e932f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:56.881480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1b03f-bf44-48b8-a76f-cac1e932f7b8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:56.888648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:56.890317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:56.890670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:56.890939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] PATH_INFO: `/v3/projects/8a4077ab228649078e8236d8d2cc75b2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:56.892632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4077ab228649078e8236d8d2cc75b2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:56.894615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:56.957664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4077ab228649078e8236d8d2cc75b2', 'request_id': 'req-acd76769-b67f-4f8c-b803-549de854a2e0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.960202 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed2da9-75a9-4584-9c35-5b9aa6d3099b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:56.960472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed2da9-75a9-4584-9c35-5b9aa6d3099b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:56.960755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed2da9-75a9-4584-9c35-5b9aa6d3099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:56.970449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4077ab228649078e8236d8d2cc75b2', 'request_id': 'req-acd76769-b67f-4f8c-b803-549de854a2e0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.976628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4077ab228649078e8236d8d2cc75b2', 'request_id': 'req-acd76769-b67f-4f8c-b803-549de854a2e0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.981647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-41ed2da9-75a9-4584-9c35-5b9aa6d3099b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:56.982918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-41ed2da9-75a9-4584-9c35-5b9aa6d3099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:56.997869 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] The token cache is being invalidate because project 8a4077ab228649078e8236d8d2cc75b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:46:56.998572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:56.999262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-acd76769-b67f-4f8c-b803-549de854a2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:46:57.001494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1249/2460] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:46:56 2022] DELETE /identity/v3/projects/8a4077ab228649078e8236d8d2cc75b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:57.006266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10a89-fee3-4dde-a7cb-375eecedf8b4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.006811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10a89-fee3-4dde-a7cb-375eecedf8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.007311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b10a89-fee3-4dde-a7cb-375eecedf8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.030109 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b3b10a89-fee3-4dde-a7cb-375eecedf8b4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:57.031535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b3b10a89-fee3-4dde-a7cb-375eecedf8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:57.061210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1212/2461] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:57.081755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed2da9-75a9-4584-9c35-5b9aa6d3099b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.083570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-41ed2da9-75a9-4584-9c35-5b9aa6d3099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:57.107148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:57.116549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1250/2462] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:57.126762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca92d-f923-4c3e-9c69-9769cefa9e18 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.127033 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca92d-f923-4c3e-9c69-9769cefa9e18 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.127305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca92d-f923-4c3e-9c69-9769cefa9e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.147461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-74cca92d-f923-4c3e-9c69-9769cefa9e18 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:57.148681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-74cca92d-f923-4c3e-9c69-9769cefa9e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:57.158957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1251/2463] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:46:57.161464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca92d-f923-4c3e-9c69-9769cefa9e18 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.171808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca92d-f923-4c3e-9c69-9769cefa9e18 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.174775 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed2da9-75a9-4584-9c35-5b9aa6d3099b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.178369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.179197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.179418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.179727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.180467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:46:57.180795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.182030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771866-a0f1-476a-91dc-168855730d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.182676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.182966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771866-a0f1-476a-91dc-168855730d19 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.183153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771866-a0f1-476a-91dc-168855730d19 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.183327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771866-a0f1-476a-91dc-168855730d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.193135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04771866-a0f1-476a-91dc-168855730d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.194821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04771866-a0f1-476a-91dc-168855730d19 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.197036 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1252/2464] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:46:57.201776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.209722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:57.212734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1213/2465] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:46:57.213640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07a02f-cdd4-4ed4-beaf-89975fa6e459 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.222235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ae9f-b6a8-4d0e-8e21-3075cd46006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.223052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ae9f-b6a8-4d0e-8e21-3075cd46006e admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.223380 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ae9f-b6a8-4d0e-8e21-3075cd46006e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.223659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ae9f-b6a8-4d0e-8e21-3075cd46006e admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.224637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7ae9f-b6a8-4d0e-8e21-3075cd46006e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.226630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7ae9f-b6a8-4d0e-8e21-3075cd46006e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.256657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1253/2466] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:46:57 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:46:57.261093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771866-a0f1-476a-91dc-168855730d19 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.271949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771866-a0f1-476a-91dc-168855730d19 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.331008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49495cd6-2bac-435a-a15f-1251f32c733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.331620 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49495cd6-2bac-435a-a15f-1251f32c733e admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.331898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49495cd6-2bac-435a-a15f-1251f32c733e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.332169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49495cd6-2bac-435a-a15f-1251f32c733e admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.332820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49495cd6-2bac-435a-a15f-1251f32c733e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.334810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49495cd6-2bac-435a-a15f-1251f32c733e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.360905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1214/2467] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:46:57 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:46:57.367285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ae9f-b6a8-4d0e-8e21-3075cd46006e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.381419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ae9f-b6a8-4d0e-8e21-3075cd46006e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.387131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051916c-462e-48dc-ac71-6dadf8a1fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.387777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051916c-462e-48dc-ac71-6dadf8a1fee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.388054 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051916c-462e-48dc-ac71-6dadf8a1fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.388324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051916c-462e-48dc-ac71-6dadf8a1fee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.388966 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051916c-462e-48dc-ac71-6dadf8a1fee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.390620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051916c-462e-48dc-ac71-6dadf8a1fee3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.402715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1254/2468] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:57.406906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49495cd6-2bac-435a-a15f-1251f32c733e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.418150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49495cd6-2bac-435a-a15f-1251f32c733e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.423768 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e611c-15ca-441a-8368-d71b62c0ca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.424425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e611c-15ca-441a-8368-d71b62c0ca2e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.424729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e611c-15ca-441a-8368-d71b62c0ca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.425003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e611c-15ca-441a-8368-d71b62c0ca2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.425881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e611c-15ca-441a-8368-d71b62c0ca2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.428187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e611c-15ca-441a-8368-d71b62c0ca2e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.439940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1215/2469] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:46:57.444897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051916c-462e-48dc-ac71-6dadf8a1fee3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.456506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051916c-462e-48dc-ac71-6dadf8a1fee3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.461651 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.462327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.462709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.462920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] PATH_INFO: `/v3/projects/66dd13f03bd44dac8cc3a512007ccedc/users/ca74ef0409334cffb3bbd88d0bdd874e/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.486148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66dd13f03bd44dac8cc3a512007ccedc, user_id=ca74ef0409334cffb3bbd88d0bdd874e, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.488844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.527511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1255/2470] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:46:57 2022] PUT /identity/v3/projects/66dd13f03bd44dac8cc3a512007ccedc/users/ca74ef0409334cffb3bbd88d0bdd874e/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:46:57.531543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37236bfa-6f62-4752-b963-ad4e641ae419 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.531953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37236bfa-6f62-4752-b963-ad4e641ae419 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.532354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37236bfa-6f62-4752-b963-ad4e641ae419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.540864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.543754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:57.607682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-37236bfa-6f62-4752-b963-ad4e641ae419 None None] MFA Rules not processed for user `ca74ef0409334cffb3bbd88d0bdd874e`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:46:57.609443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-37236bfa-6f62-4752-b963-ad4e641ae419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:57.657731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e006518-3f35-4c63-8df9-45415cc2f25d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.662977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8135e-476f-49ce-95bc-fb34b24b8411 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.663593 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8135e-476f-49ce-95bc-fb34b24b8411 service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.663868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8135e-476f-49ce-95bc-fb34b24b8411 service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.664137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8135e-476f-49ce-95bc-fb34b24b8411 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.665900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d3d8135e-476f-49ce-95bc-fb34b24b8411 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:57.678279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8135e-476f-49ce-95bc-fb34b24b8411 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.679884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8135e-476f-49ce-95bc-fb34b24b8411 service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.684830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1216/2471] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:46:57.690201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1256/2472] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:46:57.697039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37236bfa-6f62-4752-b963-ad4e641ae419 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:46:57.698904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-37236bfa-6f62-4752-b963-ad4e641ae419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:46:57.712351 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:57.775812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37236bfa-6f62-4752-b963-ad4e641ae419 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:46:57.780771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:46:57.781404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:46:57.781679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:46:57.781947 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:46:57.793059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:46:57.794719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:46:57.805760 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1217/2473] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:46:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:01.104225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7921d0-7519-48a0-89ad-055826a091bd None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:01.105851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7921d0-7519-48a0-89ad-055826a091bd None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:01.105851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7921d0-7519-48a0-89ad-055826a091bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:01.142315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ef7921d0-7519-48a0-89ad-055826a091bd None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:01.143886 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ef7921d0-7519-48a0-89ad-055826a091bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:01.239402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1257/2474] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 14:47:01.253956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:01.256684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:01.391487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22e83c-051d-4f59-88fb-2ef0af719c28 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:01.398483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd37a2-d49b-4639-a1bf-a619c2efaa06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:01.399228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd37a2-d49b-4639-a1bf-a619c2efaa06 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:01.399544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd37a2-d49b-4639-a1bf-a619c2efaa06 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:01.399856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd37a2-d49b-4639-a1bf-a619c2efaa06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:01.409958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd37a2-d49b-4639-a1bf-a619c2efaa06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:01.411804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd37a2-d49b-4639-a1bf-a619c2efaa06 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:01.423493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1218/2475] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:04.651185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0b0e-83b9-4400-9c46-92b4a48de2bf None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:04.652225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0b0e-83b9-4400-9c46-92b4a48de2bf None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:04.652953 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0b0e-83b9-4400-9c46-92b4a48de2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:04.691510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-88ea0b0e-83b9-4400-9c46-92b4a48de2bf None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:04.692082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-88ea0b0e-83b9-4400-9c46-92b4a48de2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:04.703837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1258/2476] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:47:04.751099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd37a2-d49b-4639-a1bf-a619c2efaa06 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:04.781284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd37a2-d49b-4639-a1bf-a619c2efaa06 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:04.793953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:04.794978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:04.794978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:04.795442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:04.805731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:04.807597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:04.822717 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1219/2477] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:05.655584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e720f7-0a2f-4a88-994a-34b2644fa0a6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:05.656220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e720f7-0a2f-4a88-994a-34b2644fa0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:05.656220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e720f7-0a2f-4a88-994a-34b2644fa0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:05.685604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-69e720f7-0a2f-4a88-994a-34b2644fa0a6 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:05.686872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-69e720f7-0a2f-4a88-994a-34b2644fa0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:05.731194 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:05.786870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1259/2478] 10.222.0.49 () {58 vars in 967 bytes} [Tue Aug 30 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:05.807960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:05.811296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:05.935591 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483c6b4-2edf-43bc-ba68-a28a9ac75614 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:05.950268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b4140-8c8c-48e3-948e-b6862bc7b8e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:05.950948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b4140-8c8c-48e3-948e-b6862bc7b8e5 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:05.951230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b4140-8c8c-48e3-948e-b6862bc7b8e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:05.951502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b4140-8c8c-48e3-948e-b6862bc7b8e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:05.978240 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b4140-8c8c-48e3-948e-b6862bc7b8e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:05.980259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b4140-8c8c-48e3-948e-b6862bc7b8e5 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:05.992740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1220/2479] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:47:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:47:09.481989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e720f7-0a2f-4a88-994a-34b2644fa0a6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:09.494525 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e720f7-0a2f-4a88-994a-34b2644fa0a6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:09.500929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:09.501568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:09.501849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:09.502122 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] PATH_INFO: `/v3/users/ca74ef0409334cffb3bbd88d0bdd874e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:09.503332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca74ef0409334cffb3bbd88d0bdd874e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:09.505286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:09.560653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca74ef0409334cffb3bbd88d0bdd874e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:09.573362 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca74ef0409334cffb3bbd88d0bdd874e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:09.574097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca74ef0409334cffb3bbd88d0bdd874e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:09.574717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca74ef0409334cffb3bbd88d0bdd874e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:09.583600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca74ef0409334cffb3bbd88d0bdd874e'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:09.596897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1260/2480] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:47:09 2022] DELETE /identity/v3/users/ca74ef0409334cffb3bbd88d0bdd874e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:47:09.601444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786692a1-479b-4df5-8aaf-a2bfab48b317 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:09.601922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786692a1-479b-4df5-8aaf-a2bfab48b317 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:09.602049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786692a1-479b-4df5-8aaf-a2bfab48b317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:09.621767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-786692a1-479b-4df5-8aaf-a2bfab48b317 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:09.623011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-786692a1-479b-4df5-8aaf-a2bfab48b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:09.631629 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:09.683410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1221/2481] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:09.694051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:09.695629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:09.757635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a852b-5c1e-4771-905f-9090f1801af9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:09.761661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe9af5-556d-4b1f-8cce-70a95834d8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:09.762282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9af5-556d-4b1f-8cce-70a95834d8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:09.762684 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9af5-556d-4b1f-8cce-70a95834d8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:09.762959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9af5-556d-4b1f-8cce-70a95834d8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:09.772565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe9af5-556d-4b1f-8cce-70a95834d8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:09.774011 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe9af5-556d-4b1f-8cce-70a95834d8d6 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:09.783650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1261/2482] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:10.070268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786692a1-479b-4df5-8aaf-a2bfab48b317 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.072454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-786692a1-479b-4df5-8aaf-a2bfab48b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:10.087600 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786692a1-479b-4df5-8aaf-a2bfab48b317 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:10.093753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:10.094991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.096020 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.096319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] PATH_INFO: `/v3/projects/66dd13f03bd44dac8cc3a512007ccedc` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.097830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66dd13f03bd44dac8cc3a512007ccedc)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:10.100241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:10.152142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66dd13f03bd44dac8cc3a512007ccedc', 'request_id': 'req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:10.160032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66dd13f03bd44dac8cc3a512007ccedc', 'request_id': 'req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:10.171746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66dd13f03bd44dac8cc3a512007ccedc', 'request_id': 'req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:10.184561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] The token cache is being invalidate because project 66dd13f03bd44dac8cc3a512007ccedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:47:10.184765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:10.185424 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6a83a933-9abb-4ff2-834b-9e7f0aa1843a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:47:10.194072 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1222/2483] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:47:10 2022] DELETE /identity/v3/projects/66dd13f03bd44dac8cc3a512007ccedc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:47:10.200668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85914-401f-4848-8582-c51b88e51a2e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.201213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85914-401f-4848-8582-c51b88e51a2e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.201691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85914-401f-4848-8582-c51b88e51a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.234467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7da85914-401f-4848-8582-c51b88e51a2e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:10.236633 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7da85914-401f-4848-8582-c51b88e51a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:10.295097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:10.314155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1262/2484] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:10.322219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc348c-9700-46c2-93bf-b1d45294867a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.322543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc348c-9700-46c2-93bf-b1d45294867a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.322831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc348c-9700-46c2-93bf-b1d45294867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.345160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-22fc348c-9700-46c2-93bf-b1d45294867a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:10.346430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-22fc348c-9700-46c2-93bf-b1d45294867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:10.355784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1223/2485] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:10.360803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85914-401f-4848-8582-c51b88e51a2e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.370798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85914-401f-4848-8582-c51b88e51a2e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:10.375805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:10.376386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.376661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.377401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.377576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:47:10.377875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:10.379524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:10.392000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1263/2486] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:47:10.397096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc348c-9700-46c2-93bf-b1d45294867a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.408213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc348c-9700-46c2-93bf-b1d45294867a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:10.413414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d0787-a1d6-4018-86a6-a4d476816cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:10.414041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d0787-a1d6-4018-86a6-a4d476816cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.414343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d0787-a1d6-4018-86a6-a4d476816cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.414777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d0787-a1d6-4018-86a6-a4d476816cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.415319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d0787-a1d6-4018-86a6-a4d476816cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:10.417264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d0787-a1d6-4018-86a6-a4d476816cf1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:10.449484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1224/2487] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:47:10 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:47:10.454466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.466262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d314-bc0d-4a17-8972-96b485e85561 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:10.527611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc65b-bae9-4f4b-8b4c-704cba539e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:10.528342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc65b-bae9-4f4b-8b4c-704cba539e3e admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.528512 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc65b-bae9-4f4b-8b4c-704cba539e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.528776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc65b-bae9-4f4b-8b4c-704cba539e3e admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.529414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc65b-bae9-4f4b-8b4c-704cba539e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:10.531563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc65b-bae9-4f4b-8b4c-704cba539e3e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:10.562227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1264/2488] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:47:10 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:47:10.566740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d0787-a1d6-4018-86a6-a4d476816cf1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.578136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d0787-a1d6-4018-86a6-a4d476816cf1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:10.583981 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403e847-6bae-42ae-907c-9cdeaa95ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:10.584607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e847-6bae-42ae-907c-9cdeaa95ca8f admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.584900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e847-6bae-42ae-907c-9cdeaa95ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.585121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e847-6bae-42ae-907c-9cdeaa95ca8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.585742 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403e847-6bae-42ae-907c-9cdeaa95ca8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:10.587420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403e847-6bae-42ae-907c-9cdeaa95ca8f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:10.599006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1225/2489] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:47:10.603163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc65b-bae9-4f4b-8b4c-704cba539e3e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.613950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc65b-bae9-4f4b-8b4c-704cba539e3e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:10.618890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295b8b7-ab1c-4a66-ade1-b21e4c7d7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:10.619506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b8b7-ab1c-4a66-ade1-b21e4c7d7af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.619776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b8b7-ab1c-4a66-ade1-b21e4c7d7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.620042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295b8b7-ab1c-4a66-ade1-b21e4c7d7af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.620912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295b8b7-ab1c-4a66-ade1-b21e4c7d7af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:10.622346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295b8b7-ab1c-4a66-ade1-b21e4c7d7af6 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:10.642402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1265/2490] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:47:10.646884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403e847-6bae-42ae-907c-9cdeaa95ca8f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.657728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403e847-6bae-42ae-907c-9cdeaa95ca8f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:10.663506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:10.664158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.664432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.664704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] PATH_INFO: `/v3/projects/d81b13326ea84c77a2905448b031a6c0/users/b7ee9ecd521a458d9bbe1b62b3d3bb26/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.681592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81b13326ea84c77a2905448b031a6c0, user_id=b7ee9ecd521a458d9bbe1b62b3d3bb26, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:10.684286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:10.704647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1226/2491] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:47:10 2022] PUT /identity/v3/projects/d81b13326ea84c77a2905448b031a6c0/users/b7ee9ecd521a458d9bbe1b62b3d3bb26/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:47:10.709929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058ca2-f9ad-4343-bba3-d30c696ed270 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.710209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058ca2-f9ad-4343-bba3-d30c696ed270 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.710488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058ca2-f9ad-4343-bba3-d30c696ed270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.730754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4a058ca2-f9ad-4343-bba3-d30c696ed270 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:10.732021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4a058ca2-f9ad-4343-bba3-d30c696ed270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:10.808822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1266/2492] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:10.816455 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.818186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:10.858086 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3347d-9bdb-4d52-9052-cb99d456108d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.858592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3347d-9bdb-4d52-9052-cb99d456108d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.858994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3347d-9bdb-4d52-9052-cb99d456108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.862198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:10.882545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-07b3347d-9bdb-4d52-9052-cb99d456108d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:10.883849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-07b3347d-9bdb-4d52-9052-cb99d456108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:10.886874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108c7c5-7138-4cc4-919f-3b670901acf0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:10.890488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780c988-1ed1-4459-8e35-c7ff8db9e429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:10.891307 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780c988-1ed1-4459-8e35-c7ff8db9e429 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:10.891580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780c988-1ed1-4459-8e35-c7ff8db9e429 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:10.891846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780c988-1ed1-4459-8e35-c7ff8db9e429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:10.891939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1267/2493] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:47:10.900899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780c988-1ed1-4459-8e35-c7ff8db9e429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:10.902326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780c988-1ed1-4459-8e35-c7ff8db9e429 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:10.908389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3347d-9bdb-4d52-9052-cb99d456108d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:10.909730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-07b3347d-9bdb-4d52-9052-cb99d456108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:10.913000 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1227/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:47:10.974351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:10.998712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3347d-9bdb-4d52-9052-cb99d456108d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:11.005275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:11.006209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:11.006331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:11.006537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:11.015794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:11.017412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:11.027277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1268/2495] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:47:15.115359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696e60-cc6d-4287-9bda-7b02849f20aa None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:15.116329 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696e60-cc6d-4287-9bda-7b02849f20aa None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:15.116810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696e60-cc6d-4287-9bda-7b02849f20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:15.161024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-86696e60-cc6d-4287-9bda-7b02849f20aa None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:15.162879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-86696e60-cc6d-4287-9bda-7b02849f20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:15.175008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1228/2496] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:15.207710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:15.210268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:15.230331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894c8d-6a55-432c-bb73-430899303279 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:15.238178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20824503-2550-48d2-a3ef-1788169f455e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:15.239148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20824503-2550-48d2-a3ef-1788169f455e service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:15.239683 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20824503-2550-48d2-a3ef-1788169f455e service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:15.240098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20824503-2550-48d2-a3ef-1788169f455e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:15.251451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20824503-2550-48d2-a3ef-1788169f455e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:15.253861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20824503-2550-48d2-a3ef-1788169f455e service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:15.279784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1269/2497] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:15.815563 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5b882-8906-4448-aa15-e14a7e823743 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:15.815828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5b882-8906-4448-aa15-e14a7e823743 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:15.816101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5b882-8906-4448-aa15-e14a7e823743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:15.856066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c8a5b882-8906-4448-aa15-e14a7e823743 None None] MFA Rules not processed for user `b7ee9ecd521a458d9bbe1b62b3d3bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:15.857816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c8a5b882-8906-4448-aa15-e14a7e823743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:15.953721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1229/2498] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:15.958401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20824503-2550-48d2-a3ef-1788169f455e service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:15.969582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20824503-2550-48d2-a3ef-1788169f455e service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:15.977167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aead5-c0f5-437a-ac2b-2569038e8d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:15.977865 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aead5-c0f5-437a-ac2b-2569038e8d6c admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:15.978331 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aead5-c0f5-437a-ac2b-2569038e8d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:15.979386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554aead5-c0f5-437a-ac2b-2569038e8d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:15.980286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aead5-c0f5-437a-ac2b-2569038e8d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:15.982843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554aead5-c0f5-437a-ac2b-2569038e8d6c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:16.019093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1270/2499] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:47:15 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:47:16.023241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5b882-8906-4448-aa15-e14a7e823743 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:16.035869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5b882-8906-4448-aa15-e14a7e823743 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:16.105899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e18e-067b-4632-965f-edc1c68522f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:16.107222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e18e-067b-4632-965f-edc1c68522f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:16.107506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e18e-067b-4632-965f-edc1c68522f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:16.107781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e18e-067b-4632-965f-edc1c68522f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:16.108436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245e18e-067b-4632-965f-edc1c68522f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:16.110999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245e18e-067b-4632-965f-edc1c68522f0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:16.136485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1230/2500] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:47:16 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:47:16.141384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aead5-c0f5-437a-ac2b-2569038e8d6c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:16.153047 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554aead5-c0f5-437a-ac2b-2569038e8d6c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:16.159640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bc782-813e-4f07-9ba9-8daab441b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:16.160450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bc782-813e-4f07-9ba9-8daab441b37e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:16.160857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bc782-813e-4f07-9ba9-8daab441b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:16.161246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bc782-813e-4f07-9ba9-8daab441b37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:16.162068 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bc782-813e-4f07-9ba9-8daab441b37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:16.163920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bc782-813e-4f07-9ba9-8daab441b37e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:16.175750 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1271/2501] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:47:16.182365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e18e-067b-4632-965f-edc1c68522f0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:16.194104 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e18e-067b-4632-965f-edc1c68522f0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:16.199066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a798-0956-49b8-a38d-163db23243b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:16.199756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a798-0956-49b8-a38d-163db23243b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:16.200039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a798-0956-49b8-a38d-163db23243b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:16.200315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a798-0956-49b8-a38d-163db23243b2 admin admin] PATH_INFO: `/v3/projects/124ed46a97c74dfca9e57dc14faf1722/users/bc9f7bdbfe91495cb3c7872670e0664a/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:16.225453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45a798-0956-49b8-a38d-163db23243b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124ed46a97c74dfca9e57dc14faf1722, user_id=bc9f7bdbfe91495cb3c7872670e0664a, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:16.228528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45a798-0956-49b8-a38d-163db23243b2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:16.245595 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1231/2502] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:47:16 2022] PUT /identity/v3/projects/124ed46a97c74dfca9e57dc14faf1722/users/bc9f7bdbfe91495cb3c7872670e0664a/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:47:16.249907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bc782-813e-4f07-9ba9-8daab441b37e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:16.261663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bc782-813e-4f07-9ba9-8daab441b37e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:16.333851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd0aa7-c2db-4dc3-a070-a01da16a3ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:16.334548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0aa7-c2db-4dc3-a070-a01da16a3ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:16.334826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0aa7-c2db-4dc3-a070-a01da16a3ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:16.335096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd0aa7-c2db-4dc3-a070-a01da16a3ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:16.335740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0aa7-c2db-4dc3-a070-a01da16a3ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:16.337397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd0aa7-c2db-4dc3-a070-a01da16a3ec0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:16.350209 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1272/2503] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:47:16.355996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a798-0956-49b8-a38d-163db23243b2 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:16.367526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a798-0956-49b8-a38d-163db23243b2 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:16.373179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76e351-4e2a-4e53-97b0-7b93e9536351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:16.373997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76e351-4e2a-4e53-97b0-7b93e9536351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:16.374519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76e351-4e2a-4e53-97b0-7b93e9536351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:16.374793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76e351-4e2a-4e53-97b0-7b93e9536351 admin admin] PATH_INFO: `/v3/projects/124ed46a97c74dfca9e57dc14faf1722/users/bc9f7bdbfe91495cb3c7872670e0664a/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:16.377311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76e351-4e2a-4e53-97b0-7b93e9536351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124ed46a97c74dfca9e57dc14faf1722, user_id=bc9f7bdbfe91495cb3c7872670e0664a, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:16.380102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76e351-4e2a-4e53-97b0-7b93e9536351 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:16.399994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1232/2504] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:47:16 2022] PUT /identity/v3/projects/124ed46a97c74dfca9e57dc14faf1722/users/bc9f7bdbfe91495cb3c7872670e0664a/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:47:17.223515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b712c-7fec-4256-83e5-e53446403fad None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:17.223826 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b712c-7fec-4256-83e5-e53446403fad None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:17.224057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b712c-7fec-4256-83e5-e53446403fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:17.253988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-144b712c-7fec-4256-83e5-e53446403fad None None] MFA Rules not processed for user `9406b65614734a5f86565044167bbb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:17.258029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-144b712c-7fec-4256-83e5-e53446403fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:17.378644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1273/2505] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:18.429326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de5c7-0052-4760-a944-d35d06ebaa7b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:18.429798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de5c7-0052-4760-a944-d35d06ebaa7b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:18.430005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de5c7-0052-4760-a944-d35d06ebaa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:18.484906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a46de5c7-0052-4760-a944-d35d06ebaa7b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:18.486765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a46de5c7-0052-4760-a944-d35d06ebaa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:18.509701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:18.611358 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1233/2506] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:18.629454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b712c-7fec-4256-83e5-e53446403fad None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:18.738851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:18.807724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b712c-7fec-4256-83e5-e53446403fad None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:18.816588 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2a8b-3ed2-4314-a5a0-053f07360f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:18.817450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2a8b-3ed2-4314-a5a0-053f07360f07 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:18.819066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2a8b-3ed2-4314-a5a0-053f07360f07 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:18.819572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2a8b-3ed2-4314-a5a0-053f07360f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:18.832035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b2a8b-3ed2-4314-a5a0-053f07360f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:18.834367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b2a8b-3ed2-4314-a5a0-053f07360f07 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:18.855716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1274/2507] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:47:25.021987 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9100-12b7-4e72-9121-29d1192d42c9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:25.023042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9100-12b7-4e72-9121-29d1192d42c9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:25.023576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9100-12b7-4e72-9121-29d1192d42c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:25.124544 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-06fd9100-12b7-4e72-9121-29d1192d42c9 None None] MFA Rules not processed for user `bc9f7bdbfe91495cb3c7872670e0664a`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:25.127738 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-06fd9100-12b7-4e72-9121-29d1192d42c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:25.252057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1234/2508] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:25.267035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2a8b-3ed2-4314-a5a0-053f07360f07 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:25.280361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2a8b-3ed2-4314-a5a0-053f07360f07 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:25.287007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cce13a-8fa2-4812-9c77-c1bac4e1c583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:25.288041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cce13a-8fa2-4812-9c77-c1bac4e1c583 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:25.288041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cce13a-8fa2-4812-9c77-c1bac4e1c583 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:25.288358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cce13a-8fa2-4812-9c77-c1bac4e1c583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:25.356529 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cce13a-8fa2-4812-9c77-c1bac4e1c583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:25.358149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cce13a-8fa2-4812-9c77-c1bac4e1c583 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:25.373828 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1275/2509] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:47:27.024663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268701-27e8-49d6-821a-6cfa2ba8033e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:27.025666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268701-27e8-49d6-821a-6cfa2ba8033e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:27.025666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268701-27e8-49d6-821a-6cfa2ba8033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:27.059699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fe268701-27e8-49d6-821a-6cfa2ba8033e None None] MFA Rules not processed for user `b7ee9ecd521a458d9bbe1b62b3d3bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:27.061696 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fe268701-27e8-49d6-821a-6cfa2ba8033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:27.074808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1235/2510] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:35.369545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=48 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:37.043903 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=59 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:37.789785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331ff75-17a5-4931-8d75-2716455c0a8f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:37.790722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331ff75-17a5-4931-8d75-2716455c0a8f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:37.790722 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331ff75-17a5-4931-8d75-2716455c0a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:37.818556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e331ff75-17a5-4931-8d75-2716455c0a8f None None] MFA Rules not processed for user `87f59c8ddada4de6849d6a08ae7c846d`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:37.819831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e331ff75-17a5-4931-8d75-2716455c0a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:37.892508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1276/2511] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:47.881674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=25 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:50.391083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea4476-971d-442e-a117-e346a4d6ecc4 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:50.392434 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea4476-971d-442e-a117-e346a4d6ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:50.393117 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea4476-971d-442e-a117-e346a4d6ecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:50.428665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fdea4476-971d-442e-a117-e346a4d6ecc4 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:50.431128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fdea4476-971d-442e-a117-e346a4d6ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:50.535724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1236/2512] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:47:50.567137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331ff75-17a5-4931-8d75-2716455c0a8f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:47:50.572721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e331ff75-17a5-4931-8d75-2716455c0a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:50.685516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331ff75-17a5-4931-8d75-2716455c0a8f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:47:50.698663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70c1e0-755b-4203-922f-7a308554c6dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:47:50.699899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70c1e0-755b-4203-922f-7a308554c6dd service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:50.700520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70c1e0-755b-4203-922f-7a308554c6dd service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:50.701006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70c1e0-755b-4203-922f-7a308554c6dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:50.718182 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70c1e0-755b-4203-922f-7a308554c6dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:47:50.721042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70c1e0-755b-4203-922f-7a308554c6dd service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:47:50.737241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1277/2513] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:47:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:47:58.454647 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f689-3abd-4bf3-a133-281b369f2770 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:47:58.455597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f689-3abd-4bf3-a133-281b369f2770 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:47:58.455597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152f689-3abd-4bf3-a133-281b369f2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:47:58.505284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6152f689-3abd-4bf3-a133-281b369f2770 None None] MFA Rules not processed for user `192a22cb876f4f72b09d5835b479f58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:47:58.507974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6152f689-3abd-4bf3-a133-281b369f2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:47:58.625729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1237/2514] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:00.730255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=32 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:02.095393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1decd-f5f6-402c-9a31-6ce7a52de801 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:02.096715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1decd-f5f6-402c-9a31-6ce7a52de801 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:02.097219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1decd-f5f6-402c-9a31-6ce7a52de801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:02.159611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5bf1decd-f5f6-402c-9a31-6ce7a52de801 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:02.164903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5bf1decd-f5f6-402c-9a31-6ce7a52de801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:02.202148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1278/2515] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:02.222156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152f689-3abd-4bf3-a133-281b369f2770 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:02.327802 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152f689-3abd-4bf3-a133-281b369f2770 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:02.423084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695b5be-2a1b-4858-ad4b-8d870ce72954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:02.423771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b5be-2a1b-4858-ad4b-8d870ce72954 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:02.424051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b5be-2a1b-4858-ad4b-8d870ce72954 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:02.429501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b5be-2a1b-4858-ad4b-8d870ce72954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:02.474898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695b5be-2a1b-4858-ad4b-8d870ce72954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:02.491998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695b5be-2a1b-4858-ad4b-8d870ce72954 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:02.529530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1238/2516] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:02.958670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1decd-f5f6-402c-9a31-6ce7a52de801 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:02.961205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5bf1decd-f5f6-402c-9a31-6ce7a52de801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:03.258466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1decd-f5f6-402c-9a31-6ce7a52de801 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:03.266428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff5aaa-a80d-4076-90a6-fdc6101b1281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:03.267870 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff5aaa-a80d-4076-90a6-fdc6101b1281 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:03.268745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff5aaa-a80d-4076-90a6-fdc6101b1281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:03.269532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff5aaa-a80d-4076-90a6-fdc6101b1281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:03.292326 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff5aaa-a80d-4076-90a6-fdc6101b1281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:03.295349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff5aaa-a80d-4076-90a6-fdc6101b1281 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:03.326490 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1279/2517] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:48:07.999672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726321-cd28-4bdf-a712-ca46b5157e3a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:08.001064 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726321-cd28-4bdf-a712-ca46b5157e3a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:08.001684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726321-cd28-4bdf-a712-ca46b5157e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:08.047286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-88726321-cd28-4bdf-a712-ca46b5157e3a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:08.048991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-88726321-cd28-4bdf-a712-ca46b5157e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:08.058627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1239/2518] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:08.083161 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff5aaa-a80d-4076-90a6-fdc6101b1281 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:08.100154 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff5aaa-a80d-4076-90a6-fdc6101b1281 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:08.108291 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d4802-cdb7-413e-9b4f-175d2b89425a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:08.109487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d4802-cdb7-413e-9b4f-175d2b89425a service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:08.110019 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d4802-cdb7-413e-9b4f-175d2b89425a service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:08.110537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d4802-cdb7-413e-9b4f-175d2b89425a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:08.120738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d4802-cdb7-413e-9b4f-175d2b89425a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:08.123100 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d4802-cdb7-413e-9b4f-175d2b89425a service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:08.150370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1280/2519] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:08.321512 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57bfd-389e-4ee1-b1a5-939c0b8575f6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:08.321823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57bfd-389e-4ee1-b1a5-939c0b8575f6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:08.322198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57bfd-389e-4ee1-b1a5-939c0b8575f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:08.364737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e2a57bfd-389e-4ee1-b1a5-939c0b8575f6 None None] MFA Rules not processed for user `5b64acf3f19a40ca869bf9070bad361b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:08.366368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e2a57bfd-389e-4ee1-b1a5-939c0b8575f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:08.541061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1240/2520] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:11.198968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1c668-851f-4df5-b30a-8a2152cef7fb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:11.199839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1c668-851f-4df5-b30a-8a2152cef7fb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:11.200419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1c668-851f-4df5-b30a-8a2152cef7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:11.252601 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-79e1c668-851f-4df5-b30a-8a2152cef7fb None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:11.254618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-79e1c668-851f-4df5-b30a-8a2152cef7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:11.264596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1281/2521] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:48:11.287612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a57bfd-389e-4ee1-b1a5-939c0b8575f6 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:11.327506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a57bfd-389e-4ee1-b1a5-939c0b8575f6 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:11.336004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fa99c-24fb-444d-b23f-73e58ec35b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:11.336668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa99c-24fb-444d-b23f-73e58ec35b62 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:11.337590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa99c-24fb-444d-b23f-73e58ec35b62 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:11.338500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa99c-24fb-444d-b23f-73e58ec35b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:11.359318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fa99c-24fb-444d-b23f-73e58ec35b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:11.360959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fa99c-24fb-444d-b23f-73e58ec35b62 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:11.374292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1241/2522] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:48:14.458709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3b3e-c0ba-484b-be34-d8a303d9750a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:14.459384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3b3e-c0ba-484b-be34-d8a303d9750a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:14.459384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a3b3e-c0ba-484b-be34-d8a303d9750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:14.487190 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fa6a3b3e-c0ba-484b-be34-d8a303d9750a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:14.488507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fa6a3b3e-c0ba-484b-be34-d8a303d9750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:14.500112 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1282/2523] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:14.517279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fa99c-24fb-444d-b23f-73e58ec35b62 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:14.544278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fa99c-24fb-444d-b23f-73e58ec35b62 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:14.556507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513b97-17fe-4b93-85c0-5f62df4ed7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:14.558090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513b97-17fe-4b93-85c0-5f62df4ed7af service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:14.558907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513b97-17fe-4b93-85c0-5f62df4ed7af service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:14.559797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513b97-17fe-4b93-85c0-5f62df4ed7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:14.578269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f513b97-17fe-4b93-85c0-5f62df4ed7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:14.581832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f513b97-17fe-4b93-85c0-5f62df4ed7af service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:14.604368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1242/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:16.021694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8189-9abb-4aad-8db9-f1ac1c0fdced None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:16.022243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8189-9abb-4aad-8db9-f1ac1c0fdced None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:16.022243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa8189-9abb-4aad-8db9-f1ac1c0fdced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:16.043520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-26aa8189-9abb-4aad-8db9-f1ac1c0fdced None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:16.044942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-26aa8189-9abb-4aad-8db9-f1ac1c0fdced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:16.054045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1283/2525] 10.222.0.49 () {58 vars in 967 bytes} [Tue Aug 30 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:16.069939 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513b97-17fe-4b93-85c0-5f62df4ed7af service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:16.082407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513b97-17fe-4b93-85c0-5f62df4ed7af service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:16.089323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece81f7-0763-4258-9bb9-a6e89ee82b95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:16.090135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece81f7-0763-4258-9bb9-a6e89ee82b95 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:16.090991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece81f7-0763-4258-9bb9-a6e89ee82b95 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:16.091376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece81f7-0763-4258-9bb9-a6e89ee82b95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:16.099165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:16.102791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece81f7-0763-4258-9bb9-a6e89ee82b95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:16.105740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece81f7-0763-4258-9bb9-a6e89ee82b95 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:16.117089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1243/2526] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:48:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:48:17.677191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f91ee-a1a4-42d1-bb41-fb82019a1da1 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:17.678145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f91ee-a1a4-42d1-bb41-fb82019a1da1 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:17.678145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f91ee-a1a4-42d1-bb41-fb82019a1da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:17.703743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-903f91ee-a1a4-42d1-bb41-fb82019a1da1 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:17.704969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-903f91ee-a1a4-42d1-bb41-fb82019a1da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:17.712986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1284/2527] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Aug 30 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:17.759303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece81f7-0763-4258-9bb9-a6e89ee82b95 service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:17.772561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece81f7-0763-4258-9bb9-a6e89ee82b95 service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:17.782759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed908f-0d2f-41ac-9bce-a8c9ffa46da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:17.783388 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed908f-0d2f-41ac-9bce-a8c9ffa46da0 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:17.783667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed908f-0d2f-41ac-9bce-a8c9ffa46da0 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:17.783938 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed908f-0d2f-41ac-9bce-a8c9ffa46da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:17.793820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed908f-0d2f-41ac-9bce-a8c9ffa46da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:17.795421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed908f-0d2f-41ac-9bce-a8c9ffa46da0 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:17.807098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1244/2528] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:18.417764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f91ee-a1a4-42d1-bb41-fb82019a1da1 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:18.420911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-903f91ee-a1a4-42d1-bb41-fb82019a1da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:18.439229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f91ee-a1a4-42d1-bb41-fb82019a1da1 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:18.443845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:18.444514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:18.444789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:18.445066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] PATH_INFO: `/v3/users/9406b65614734a5f86565044167bbb95` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:18.446238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9406b65614734a5f86565044167bbb95)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:18.448408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:18.507915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9406b65614734a5f86565044167bbb95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:18.520355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9406b65614734a5f86565044167bbb95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:18.521118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9406b65614734a5f86565044167bbb95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:18.521761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9406b65614734a5f86565044167bbb95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:18.533679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-3a9aa5d0-3170-431a-8a83-b20b02feff15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9406b65614734a5f86565044167bbb95'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:18.547510 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1285/2529] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:48:18 2022] DELETE /identity/v3/users/9406b65614734a5f86565044167bbb95 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:48:18.847429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed908f-0d2f-41ac-9bce-a8c9ffa46da0 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:18.865579 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed908f-0d2f-41ac-9bce-a8c9ffa46da0 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:18.943858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:18.944558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:18.944968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:18.945289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] PATH_INFO: `/v3/projects/361e41f6b3bd41ba86e8bf01d332b924` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:18.946542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=361e41f6b3bd41ba86e8bf01d332b924)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:18.948561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:19.006225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361e41f6b3bd41ba86e8bf01d332b924', 'request_id': 'req-c62b867f-fc44-4798-aa81-02533ef0a46c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:19.013348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361e41f6b3bd41ba86e8bf01d332b924', 'request_id': 'req-c62b867f-fc44-4798-aa81-02533ef0a46c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:19.024209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361e41f6b3bd41ba86e8bf01d332b924', 'request_id': 'req-c62b867f-fc44-4798-aa81-02533ef0a46c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:19.038741 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] The token cache is being invalidate because project 361e41f6b3bd41ba86e8bf01d332b924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:48:19.039123 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:19.040069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:19.041604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1245/2530] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:48:18 2022] DELETE /identity/v3/projects/361e41f6b3bd41ba86e8bf01d332b924 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:48:25.818136 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b68d-354f-4654-998e-5c838543893d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:25.818731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b68d-354f-4654-998e-5c838543893d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:25.818731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b68d-354f-4654-998e-5c838543893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:25.838746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-0846b68d-354f-4654-998e-5c838543893d None None] MFA Rules not processed for user `98468f7877eb48889976ecba85a776ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:48:25.839962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0846b68d-354f-4654-998e-5c838543893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:25.865308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:25.901431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1286/2531] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:48:29.034621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:35.891723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=12 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:50.796865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:50.798867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:50.862082 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b867f-fc44-4798-aa81-02533ef0a46c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:50.866485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:50.867095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:50.867370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:50.867638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:50.869538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:50.945862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:50.947353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:50.958543 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1246/2532] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:52.153716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846b68d-354f-4654-998e-5c838543893d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:52.155626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0846b68d-354f-4654-998e-5c838543893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:52.169295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846b68d-354f-4654-998e-5c838543893d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:52.174592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:52.175297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:52.175578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:52.175999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:52.177723 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:52.193973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:52.195620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:52.209851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1287/2533] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:48:52.225264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:52.230702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:48:52.327041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b911c-7377-41bd-83fa-d28ade9c4889 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:52.332961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:52.333634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:52.333907 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:52.334174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] PATH_INFO: `/v3/users/87f59c8ddada4de6849d6a08ae7c846d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:52.335458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f59c8ddada4de6849d6a08ae7c846d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:52.337445 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:52.388820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:52.390777 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f59c8ddada4de6849d6a08ae7c846d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.406583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f59c8ddada4de6849d6a08ae7c846d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.415304 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f59c8ddada4de6849d6a08ae7c846d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.416174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f59c8ddada4de6849d6a08ae7c846d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.416703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f59c8ddada4de6849d6a08ae7c846d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.433969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1247/2534] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:48:52 2022] DELETE /identity/v3/users/87f59c8ddada4de6849d6a08ae7c846d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:48:52.634160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:48:52.648247 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4d44-637c-4d19-b22a-1a89a456ff5f service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:48:52.716467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:48:52.717227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:48:52.717553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:48:52.717874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] PATH_INFO: `/v3/projects/a016b08be8f74963817782336c9638a6` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:48:52.719351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a016b08be8f74963817782336c9638a6)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:48:52.721332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:48:52.772038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a016b08be8f74963817782336c9638a6', 'request_id': 'req-74816363-77e7-4b70-bf2b-6ae472adfdf0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.778404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a016b08be8f74963817782336c9638a6', 'request_id': 'req-74816363-77e7-4b70-bf2b-6ae472adfdf0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.784453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a016b08be8f74963817782336c9638a6', 'request_id': 'req-74816363-77e7-4b70-bf2b-6ae472adfdf0'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.800145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] The token cache is being invalidate because project a016b08be8f74963817782336c9638a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:48:52.800455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.801080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:48:52.802626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1288/2535] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:48:52 2022] DELETE /identity/v3/projects/a016b08be8f74963817782336c9638a6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:02.430056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:02.796550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:03.699772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:03.701466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:03.783281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358ec1-a79b-49c1-86ac-918fcb24ad05 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:03.852619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:03.853257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:03.853535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:03.853800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:03.856054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:03.916806 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:03.918451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:03.933729 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1248/2536] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:09.062051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:09.063912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:09.126933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816363-77e7-4b70-bf2b-6ae472adfdf0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:09.130791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:09.131422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:09.131697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:09.131962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:09.133923 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:09.210531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:09.211999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:09.223559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1289/2537] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:12.728322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:12.738598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:12.809015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:12.830452 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef83054-7b31-47f6-9cbb-cbfac5617500 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:12.836353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:12.837941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:12.838363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:12.838830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:12.843053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:12.938816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:12.946753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:12.964465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1249/2538] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:13.285968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:13.287508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:13.302932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acc65b-516a-4f11-9195-5bddcfda650f service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:13.308266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:13.308914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:13.309191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:13.309465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] PATH_INFO: `/v3/users/192a22cb876f4f72b09d5835b479f58c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:13.310653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192a22cb876f4f72b09d5835b479f58c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:13.312824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:13.365725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192a22cb876f4f72b09d5835b479f58c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.387412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192a22cb876f4f72b09d5835b479f58c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.388498 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192a22cb876f4f72b09d5835b479f58c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.389313 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192a22cb876f4f72b09d5835b479f58c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.399765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7701880e-8573-41ec-8205-104941d21c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192a22cb876f4f72b09d5835b479f58c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.417345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1290/2539] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:49:13 2022] DELETE /identity/v3/users/192a22cb876f4f72b09d5835b479f58c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:13.619998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:13.636498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee16c-06ca-4428-a6bf-c9a3927723cc service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:13.709177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:13.709839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:13.710118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:13.710428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] PATH_INFO: `/v3/projects/86eca317ac0a44a49a48f81119ee2485` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:13.711610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86eca317ac0a44a49a48f81119ee2485)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:13.713592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:13.767793 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86eca317ac0a44a49a48f81119ee2485', 'request_id': 'req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.775582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86eca317ac0a44a49a48f81119ee2485', 'request_id': 'req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.785463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86eca317ac0a44a49a48f81119ee2485', 'request_id': 'req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.804173 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] The token cache is being invalidate because project 86eca317ac0a44a49a48f81119ee2485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:49:13.804657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.805697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7c7e20fe-ea63-4e68-969f-4f0fb1efcb91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:13.808217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1250/2540] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:49:13 2022] DELETE /identity/v3/projects/86eca317ac0a44a49a48f81119ee2485 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:13.816474 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fafc4-c729-4d92-81c5-1d410d0a5e1f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:13.816765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fafc4-c729-4d92-81c5-1d410d0a5e1f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:13.817011 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fafc4-c729-4d92-81c5-1d410d0a5e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:13.841099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-e50fafc4-c729-4d92-81c5-1d410d0a5e1f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:13.842353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e50fafc4-c729-4d92-81c5-1d410d0a5e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:13.866622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:13.917008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1291/2541] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:13.926874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af771d84-7e05-4310-8f60-d2f865fda2b8 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:13.927162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af771d84-7e05-4310-8f60-d2f865fda2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:13.927441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af771d84-7e05-4310-8f60-d2f865fda2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:13.949357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-af771d84-7e05-4310-8f60-d2f865fda2b8 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:13.950658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-af771d84-7e05-4310-8f60-d2f865fda2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:13.964636 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1251/2542] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:13.966245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fafc4-c729-4d92-81c5-1d410d0a5e1f None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:13.976876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fafc4-c729-4d92-81c5-1d410d0a5e1f None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:13.981664 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:13.982276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:13.982600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:13.982871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:13.983518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:49:13.983819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:13.985582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:13.998418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1292/2543] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:49:14.003659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af771d84-7e05-4310-8f60-d2f865fda2b8 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:14.013474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af771d84-7e05-4310-8f60-d2f865fda2b8 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:14.018819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a6e76-fda9-4038-8c58-ef3884acdcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:14.019502 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6e76-fda9-4038-8c58-ef3884acdcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:14.019774 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6e76-fda9-4038-8c58-ef3884acdcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:14.020040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6e76-fda9-4038-8c58-ef3884acdcb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:14.020700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a6e76-fda9-4038-8c58-ef3884acdcb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:14.022691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a6e76-fda9-4038-8c58-ef3884acdcb0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:14.035352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:14.058203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1252/2544] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:49:14 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:49:14.063018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:14.074537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e392-32ad-41fe-beff-fa90faa14525 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:14.148918 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f1adf-db1a-406e-b5af-2cf267196045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:14.149596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f1adf-db1a-406e-b5af-2cf267196045 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:14.149874 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f1adf-db1a-406e-b5af-2cf267196045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:14.150149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f1adf-db1a-406e-b5af-2cf267196045 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:14.150882 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f1adf-db1a-406e-b5af-2cf267196045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:14.152843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f1adf-db1a-406e-b5af-2cf267196045 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:14.184395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1293/2545] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:49:14 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:14.190310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a6e76-fda9-4038-8c58-ef3884acdcb0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:14.202044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a6e76-fda9-4038-8c58-ef3884acdcb0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:14.207687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d536af1-00fb-4965-b997-92cb8561a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:14.208340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536af1-00fb-4965-b997-92cb8561a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:14.208619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536af1-00fb-4965-b997-92cb8561a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:14.208888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d536af1-00fb-4965-b997-92cb8561a3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:14.209695 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d536af1-00fb-4965-b997-92cb8561a3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:14.212757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d536af1-00fb-4965-b997-92cb8561a3f6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:14.232138 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1253/2546] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:14.238237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f1adf-db1a-406e-b5af-2cf267196045 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:14.258885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f1adf-db1a-406e-b5af-2cf267196045 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:14.267557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25060d30-c66d-4e74-ad09-7149ae6a7b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:14.269174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060d30-c66d-4e74-ad09-7149ae6a7b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:14.269646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060d30-c66d-4e74-ad09-7149ae6a7b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:14.270118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25060d30-c66d-4e74-ad09-7149ae6a7b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:14.271411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25060d30-c66d-4e74-ad09-7149ae6a7b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:14.274596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25060d30-c66d-4e74-ad09-7149ae6a7b49 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:14.297991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1294/2547] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:14.303600 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d536af1-00fb-4965-b997-92cb8561a3f6 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:14.320281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d536af1-00fb-4965-b997-92cb8561a3f6 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:14.327474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:14.328390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:14.328731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:14.329011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] PATH_INFO: `/v3/projects/19100e96d6da471faa67204f797095e0/users/95fc7561d6b34e0ca6a6da250acaee2f/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:14.356715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19100e96d6da471faa67204f797095e0, user_id=95fc7561d6b34e0ca6a6da250acaee2f, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:14.361598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:14.380119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1254/2548] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:49:14 2022] PUT /identity/v3/projects/19100e96d6da471faa67204f797095e0/users/95fc7561d6b34e0ca6a6da250acaee2f/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:14.392463 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d76d-3dd0-48f2-bf59-d94d6129f20e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:14.392897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d76d-3dd0-48f2-bf59-d94d6129f20e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:14.393328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d76d-3dd0-48f2-bf59-d94d6129f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:14.442314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4375d76d-3dd0-48f2-bf59-d94d6129f20e None None] MFA Rules not processed for user `95fc7561d6b34e0ca6a6da250acaee2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:14.444370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4375d76d-3dd0-48f2-bf59-d94d6129f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:14.543204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1295/2549] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:14.553505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:14.555231 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:14.662219 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e7c67-91f0-4fb5-9f58-963ea249cde0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:14.668212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b4fe8-d9b0-474b-b5c3-d1629f5476ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:14.668849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4fe8-d9b0-474b-b5c3-d1629f5476ab service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:14.669128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4fe8-d9b0-474b-b5c3-d1629f5476ab service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:14.669437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4fe8-d9b0-474b-b5c3-d1629f5476ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:14.681883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b4fe8-d9b0-474b-b5c3-d1629f5476ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:14.685739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b4fe8-d9b0-474b-b5c3-d1629f5476ab service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:14.701337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1255/2550] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:49:17.547335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d76d-3dd0-48f2-bf59-d94d6129f20e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:17.567861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:17.632121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d76d-3dd0-48f2-bf59-d94d6129f20e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:17.638327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:17.639120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:17.639477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:17.639867 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] PATH_INFO: `/v3/users/95fc7561d6b34e0ca6a6da250acaee2f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:17.641527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fc7561d6b34e0ca6a6da250acaee2f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:17.643856 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:17.698693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fc7561d6b34e0ca6a6da250acaee2f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:17.712837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fc7561d6b34e0ca6a6da250acaee2f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:17.713685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fc7561d6b34e0ca6a6da250acaee2f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:17.714448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fc7561d6b34e0ca6a6da250acaee2f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:17.725461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fc7561d6b34e0ca6a6da250acaee2f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:17.741579 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1296/2551] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:49:17 2022] DELETE /identity/v3/users/95fc7561d6b34e0ca6a6da250acaee2f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:17.746654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313a3d7-a1a4-4846-a6a1-c0098656840c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:17.747270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313a3d7-a1a4-4846-a6a1-c0098656840c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:17.747270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313a3d7-a1a4-4846-a6a1-c0098656840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:17.768918 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2313a3d7-a1a4-4846-a6a1-c0098656840c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:17.770084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2313a3d7-a1a4-4846-a6a1-c0098656840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:17.837622 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1256/2552] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:17.848453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:17.849979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:17.913157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0226046-553b-4c52-bb72-617ae9febe31 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:17.917063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cc999-7085-4ee0-aac4-d2079d0e3712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:17.917700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cc999-7085-4ee0-aac4-d2079d0e3712 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:17.917978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cc999-7085-4ee0-aac4-d2079d0e3712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:17.918249 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cc999-7085-4ee0-aac4-d2079d0e3712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:17.930128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cc999-7085-4ee0-aac4-d2079d0e3712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:17.931654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cc999-7085-4ee0-aac4-d2079d0e3712 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:17.943149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1297/2553] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:18.258259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313a3d7-a1a4-4846-a6a1-c0098656840c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:18.260120 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2313a3d7-a1a4-4846-a6a1-c0098656840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:18.275278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313a3d7-a1a4-4846-a6a1-c0098656840c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:18.281429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:18.282341 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.282646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.282919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] PATH_INFO: `/v3/projects/19100e96d6da471faa67204f797095e0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.284541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19100e96d6da471faa67204f797095e0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:18.286568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:18.335803 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:18.354095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19100e96d6da471faa67204f797095e0', 'request_id': 'req-95c69c61-b722-46cb-a442-3e26739566e0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:18.364289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19100e96d6da471faa67204f797095e0', 'request_id': 'req-95c69c61-b722-46cb-a442-3e26739566e0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:18.377576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19100e96d6da471faa67204f797095e0', 'request_id': 'req-95c69c61-b722-46cb-a442-3e26739566e0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:18.395435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] The token cache is being invalidate because project 19100e96d6da471faa67204f797095e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:49:18.396549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:18.396782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-95c69c61-b722-46cb-a442-3e26739566e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:18.399271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1257/2554] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:49:18 2022] DELETE /identity/v3/projects/19100e96d6da471faa67204f797095e0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:49:18.406507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998a640-6b1b-48c4-a451-030db2f6b87c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.406507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998a640-6b1b-48c4-a451-030db2f6b87c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.406507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998a640-6b1b-48c4-a451-030db2f6b87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.436959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b998a640-6b1b-48c4-a451-030db2f6b87c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:18.439864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b998a640-6b1b-48c4-a451-030db2f6b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:18.505131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:18.555626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1298/2555] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:18.557750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0a63-d62b-4566-bfc6-d9423e94f33d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.558029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0a63-d62b-4566-bfc6-d9423e94f33d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.558295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0a63-d62b-4566-bfc6-d9423e94f33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.581258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fe6b0a63-d62b-4566-bfc6-d9423e94f33d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:18.583091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fe6b0a63-d62b-4566-bfc6-d9423e94f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:18.595421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1258/2556] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:18.601083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998a640-6b1b-48c4-a451-030db2f6b87c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:18.611804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998a640-6b1b-48c4-a451-030db2f6b87c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:18.616700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:18.617316 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.617611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.617853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.618547 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:49:18.618855 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:18.620499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:18.633992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1299/2557] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:49:18.638889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b0a63-d62b-4566-bfc6-d9423e94f33d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:18.648958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b0a63-d62b-4566-bfc6-d9423e94f33d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:18.653883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710419-1921-49f1-bdf1-e7ee28f09d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:18.654550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710419-1921-49f1-bdf1-e7ee28f09d24 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.654828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710419-1921-49f1-bdf1-e7ee28f09d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.655092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710419-1921-49f1-bdf1-e7ee28f09d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.655727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f710419-1921-49f1-bdf1-e7ee28f09d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:18.657847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f710419-1921-49f1-bdf1-e7ee28f09d24 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:18.691045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1259/2558] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:49:18 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:18.696262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:18.708478 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219895b1-7ecc-43bd-afa2-1eccd2907b85 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:18.777381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abcfd6-10d2-4696-9a90-176d52857707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:18.778026 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abcfd6-10d2-4696-9a90-176d52857707 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.778293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abcfd6-10d2-4696-9a90-176d52857707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.778592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abcfd6-10d2-4696-9a90-176d52857707 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.779229 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abcfd6-10d2-4696-9a90-176d52857707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:18.781239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abcfd6-10d2-4696-9a90-176d52857707 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:18.808262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1300/2559] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:49:18 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:49:18.811245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710419-1921-49f1-bdf1-e7ee28f09d24 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:18.822925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710419-1921-49f1-bdf1-e7ee28f09d24 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:18.829287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be456d2f-e90d-4cb6-b947-f8cabc6843ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:18.830131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456d2f-e90d-4cb6-b947-f8cabc6843ba admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.830566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456d2f-e90d-4cb6-b947-f8cabc6843ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.830922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456d2f-e90d-4cb6-b947-f8cabc6843ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.831587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be456d2f-e90d-4cb6-b947-f8cabc6843ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:18.833270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be456d2f-e90d-4cb6-b947-f8cabc6843ba admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:18.845959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1260/2560] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:18.850568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abcfd6-10d2-4696-9a90-176d52857707 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:18.861299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abcfd6-10d2-4696-9a90-176d52857707 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:18.866638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85756-e9b5-48da-bc43-1e19a873ce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:18.867256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85756-e9b5-48da-bc43-1e19a873ce00 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.867530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85756-e9b5-48da-bc43-1e19a873ce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.867793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85756-e9b5-48da-bc43-1e19a873ce00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.868576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e85756-e9b5-48da-bc43-1e19a873ce00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:18.870280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e85756-e9b5-48da-bc43-1e19a873ce00 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:18.885594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1301/2561] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:18.889857 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be456d2f-e90d-4cb6-b947-f8cabc6843ba admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:18.906772 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be456d2f-e90d-4cb6-b947-f8cabc6843ba admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:18.914078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:18.914906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.915204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.915575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] PATH_INFO: `/v3/projects/3c2641b6ab5f41c08073ddb1e4c7fcbc/users/9f2103c2f6d240739d3514f73c2e0f17/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:18.941926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2641b6ab5f41c08073ddb1e4c7fcbc, user_id=9f2103c2f6d240739d3514f73c2e0f17, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:18.947484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:18.967663 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1261/2562] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:49:18 2022] PUT /identity/v3/projects/3c2641b6ab5f41c08073ddb1e4c7fcbc/users/9f2103c2f6d240739d3514f73c2e0f17/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:18.980747 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f0a12-4e6f-4022-8a10-878e50465a0d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:18.981094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f0a12-4e6f-4022-8a10-878e50465a0d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:18.981433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f0a12-4e6f-4022-8a10-878e50465a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:19.015921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-da0f0a12-4e6f-4022-8a10-878e50465a0d None None] MFA Rules not processed for user `9f2103c2f6d240739d3514f73c2e0f17`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:19.017477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-da0f0a12-4e6f-4022-8a10-878e50465a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:19.094169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1302/2563] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:19.107526 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:19.109996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:19.182079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5604df-ec82-4756-a28f-01705ebc602c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:19.186465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c362e-8623-443a-9b65-f648811c07dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89357dc69c8f456580613061f2cbef07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:19.187091 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c362e-8623-443a-9b65-f648811c07dc service glance] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:19.187373 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c362e-8623-443a-9b65-f648811c07dc service glance] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:19.187645 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c362e-8623-443a-9b65-f648811c07dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:19.197684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c362e-8623-443a-9b65-f648811c07dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:19.199189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c362e-8623-443a-9b65-f648811c07dc service glance] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:19.212567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1262/2564] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:27.109310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f0a12-4e6f-4022-8a10-878e50465a0d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:27.111635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-da0f0a12-4e6f-4022-8a10-878e50465a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:27.186845 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:27.247950 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f0a12-4e6f-4022-8a10-878e50465a0d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:27.257431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:27.258518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:27.258788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:27.259216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:27.262024 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:27.354779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:27.356515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:27.372635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1303/2565] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:28.049040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b155c-a1d3-442c-a385-2db499a93baf None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:28.049672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b155c-a1d3-442c-a385-2db499a93baf None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:28.050204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b155c-a1d3-442c-a385-2db499a93baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:28.080053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-321b155c-a1d3-442c-a385-2db499a93baf None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:28.081414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-321b155c-a1d3-442c-a385-2db499a93baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:28.166108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1263/2566] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:28.243366 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:28.245307 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:28.333164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3329-1852-4d1e-b5d1-4b18271c2ddf service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:28.338638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45767-f10c-4e11-9fe6-15c577141307 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:28.339273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45767-f10c-4e11-9fe6-15c577141307 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:28.339548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45767-f10c-4e11-9fe6-15c577141307 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:28.339818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45767-f10c-4e11-9fe6-15c577141307 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:28.350010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45767-f10c-4e11-9fe6-15c577141307 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:28.351919 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45767-f10c-4e11-9fe6-15c577141307 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:28.363341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1304/2567] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:49:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:49:34.217863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b155c-a1d3-442c-a385-2db499a93baf None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:34.229546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:34.310037 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b155c-a1d3-442c-a385-2db499a93baf None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:34.316170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:34.316846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:34.317186 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:34.317462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] PATH_INFO: `/v3/users/9f2103c2f6d240739d3514f73c2e0f17` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:34.318646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2103c2f6d240739d3514f73c2e0f17)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:34.323055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:34.400524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2103c2f6d240739d3514f73c2e0f17'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:34.418396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2103c2f6d240739d3514f73c2e0f17'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:34.428051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2103c2f6d240739d3514f73c2e0f17'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:34.428791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2103c2f6d240739d3514f73c2e0f17'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:34.429465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2103c2f6d240739d3514f73c2e0f17'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:34.454426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1264/2568] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:49:34 2022] DELETE /identity/v3/users/9f2103c2f6d240739d3514f73c2e0f17 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:34.455991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837fcb5-eb65-407b-ad3a-f3914e220b9d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:34.456501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837fcb5-eb65-407b-ad3a-f3914e220b9d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:34.456610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837fcb5-eb65-407b-ad3a-f3914e220b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:34.482060 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d837fcb5-eb65-407b-ad3a-f3914e220b9d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:34.483838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d837fcb5-eb65-407b-ad3a-f3914e220b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:34.566087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1305/2569] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:34.577660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:34.580157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:34.668288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5160d-44af-4da4-9cd5-c7714be4e6b3 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:34.673244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd298628-f533-4f8e-b10e-3300a448c472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:34.673999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298628-f533-4f8e-b10e-3300a448c472 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:34.674394 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298628-f533-4f8e-b10e-3300a448c472 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:34.674771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298628-f533-4f8e-b10e-3300a448c472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:34.689705 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd298628-f533-4f8e-b10e-3300a448c472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:34.692808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd298628-f533-4f8e-b10e-3300a448c472 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:34.709215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1265/2570] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:35.101626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837fcb5-eb65-407b-ad3a-f3914e220b9d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:35.104044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d837fcb5-eb65-407b-ad3a-f3914e220b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:35.130864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:35.141007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837fcb5-eb65-407b-ad3a-f3914e220b9d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:35.147456 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:35.149251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.150283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.151018 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] PATH_INFO: `/v3/projects/3c2641b6ab5f41c08073ddb1e4c7fcbc` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.153206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2641b6ab5f41c08073ddb1e4c7fcbc)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:35.157260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:35.234037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2641b6ab5f41c08073ddb1e4c7fcbc', 'request_id': 'req-74bad858-6275-422c-99b7-f320d4f5913c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:35.240861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2641b6ab5f41c08073ddb1e4c7fcbc', 'request_id': 'req-74bad858-6275-422c-99b7-f320d4f5913c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:35.248175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2641b6ab5f41c08073ddb1e4c7fcbc', 'request_id': 'req-74bad858-6275-422c-99b7-f320d4f5913c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:35.265099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] The token cache is being invalidate because project 3c2641b6ab5f41c08073ddb1e4c7fcbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:49:35.265565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:35.266580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-74bad858-6275-422c-99b7-f320d4f5913c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:35.273776 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1306/2571] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:49:35 2022] DELETE /identity/v3/projects/3c2641b6ab5f41c08073ddb1e4c7fcbc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:35.275459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39fbf7-d370-4aba-8123-bd57e49c544d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.276085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39fbf7-d370-4aba-8123-bd57e49c544d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.276085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39fbf7-d370-4aba-8123-bd57e49c544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.300666 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fc39fbf7-d370-4aba-8123-bd57e49c544d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:35.301908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fc39fbf7-d370-4aba-8123-bd57e49c544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:35.334800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:35.377562 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1266/2572] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:35.386248 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd22828-091f-42be-b490-ef6b4af4a948 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.386624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd22828-091f-42be-b490-ef6b4af4a948 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.386988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd22828-091f-42be-b490-ef6b4af4a948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.414155 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5fd22828-091f-42be-b490-ef6b4af4a948 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:35.416690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5fd22828-091f-42be-b490-ef6b4af4a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:35.430272 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1307/2573] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:35.434506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39fbf7-d370-4aba-8123-bd57e49c544d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:35.445787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39fbf7-d370-4aba-8123-bd57e49c544d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:35.451237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:35.451933 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.452277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.452277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.453507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:49:35.453869 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:35.455712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:35.478680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd22828-091f-42be-b490-ef6b4af4a948 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:35.484825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1267/2574] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:49:35.489841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd22828-091f-42be-b490-ef6b4af4a948 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:35.495767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11168d5d-6665-4f4d-9ebf-af288063dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:35.496382 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168d5d-6665-4f4d-9ebf-af288063dde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.496680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168d5d-6665-4f4d-9ebf-af288063dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.496941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11168d5d-6665-4f4d-9ebf-af288063dde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.497571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11168d5d-6665-4f4d-9ebf-af288063dde8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:35.499718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11168d5d-6665-4f4d-9ebf-af288063dde8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:35.538196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1308/2575] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:49:35 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:35.544491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:35.564026 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea73c9-4e28-479d-8e9f-650a464f7406 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:35.643521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5041-1424-452a-b585-027826b1a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:35.644486 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5041-1424-452a-b585-027826b1a76a admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.644969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5041-1424-452a-b585-027826b1a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.645429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5041-1424-452a-b585-027826b1a76a admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.646470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5041-1424-452a-b585-027826b1a76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:35.648635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5041-1424-452a-b585-027826b1a76a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:35.674916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1268/2576] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:49:35 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:35.679340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11168d5d-6665-4f4d-9ebf-af288063dde8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:35.698003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11168d5d-6665-4f4d-9ebf-af288063dde8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:35.703589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b683b-7506-4c46-8369-7ea17174994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:35.704284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b683b-7506-4c46-8369-7ea17174994a admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.704625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b683b-7506-4c46-8369-7ea17174994a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.704958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b683b-7506-4c46-8369-7ea17174994a admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.705668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b683b-7506-4c46-8369-7ea17174994a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:35.707491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b683b-7506-4c46-8369-7ea17174994a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:35.718528 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1309/2577] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:35.722568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5041-1424-452a-b585-027826b1a76a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:35.733302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5041-1424-452a-b585-027826b1a76a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:35.740956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93306ac-cf29-446c-90fa-672efc125e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:35.741602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93306ac-cf29-446c-90fa-672efc125e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.741956 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93306ac-cf29-446c-90fa-672efc125e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.742292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93306ac-cf29-446c-90fa-672efc125e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.743106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93306ac-cf29-446c-90fa-672efc125e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:35.744841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93306ac-cf29-446c-90fa-672efc125e8e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:35.760828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1269/2578] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:35.762167 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b683b-7506-4c46-8369-7ea17174994a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:35.773780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b683b-7506-4c46-8369-7ea17174994a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:35.778613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:35.779333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.779620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.779890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] PATH_INFO: `/v3/projects/07800216f18447f9bb1c733fa7235e96/users/f7f319d0de384af291b684588baa0fb0/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.806635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=07800216f18447f9bb1c733fa7235e96, user_id=f7f319d0de384af291b684588baa0fb0, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:35.810457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:35.835003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1310/2579] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:49:35 2022] PUT /identity/v3/projects/07800216f18447f9bb1c733fa7235e96/users/f7f319d0de384af291b684588baa0fb0/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:35.850625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031161-0fbc-43d5-a0d6-f5402cf5fb76 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:35.850996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031161-0fbc-43d5-a0d6-f5402cf5fb76 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:35.854496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031161-0fbc-43d5-a0d6-f5402cf5fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:35.906783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b6031161-0fbc-43d5-a0d6-f5402cf5fb76 None None] MFA Rules not processed for user `f7f319d0de384af291b684588baa0fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:35.907588 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b6031161-0fbc-43d5-a0d6-f5402cf5fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:36.041796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1270/2580] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:36.054692 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:36.057208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:36.152279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520667cf-c447-4c2e-bff2-77a29f509fec admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:36.160048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7053c-fed7-4d4e-bb91-e0e1c7caf1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:36.161073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7053c-fed7-4d4e-bb91-e0e1c7caf1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:36.161358 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7053c-fed7-4d4e-bb91-e0e1c7caf1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:36.161634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7053c-fed7-4d4e-bb91-e0e1c7caf1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:36.173894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7053c-fed7-4d4e-bb91-e0e1c7caf1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:36.175544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7053c-fed7-4d4e-bb91-e0e1c7caf1c6 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:36.192216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1311/2581] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:49:39.149414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031161-0fbc-43d5-a0d6-f5402cf5fb76 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:39.185209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:39.223651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031161-0fbc-43d5-a0d6-f5402cf5fb76 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:39.228686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:39.229328 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:39.229604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:39.229875 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] PATH_INFO: `/v3/users/f7f319d0de384af291b684588baa0fb0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:39.231097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f319d0de384af291b684588baa0fb0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:39.233040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:39.284688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f319d0de384af291b684588baa0fb0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:39.297607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f319d0de384af291b684588baa0fb0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:39.305153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f319d0de384af291b684588baa0fb0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:39.305876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f319d0de384af291b684588baa0fb0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:39.306521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f319d0de384af291b684588baa0fb0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:39.324014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1271/2582] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:49:39 2022] DELETE /identity/v3/users/f7f319d0de384af291b684588baa0fb0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:39.328975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84c01-d8b9-4ce2-a26d-be3ea8d51662 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:39.330082 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84c01-d8b9-4ce2-a26d-be3ea8d51662 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:39.330581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84c01-d8b9-4ce2-a26d-be3ea8d51662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:39.357885 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-37c84c01-d8b9-4ce2-a26d-be3ea8d51662 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:39.359543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-37c84c01-d8b9-4ce2-a26d-be3ea8d51662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:39.379890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:39.425922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1312/2583] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:39.436199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:39.437743 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:39.463399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c84c01-d8b9-4ce2-a26d-be3ea8d51662 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:39.465413 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-37c84c01-d8b9-4ce2-a26d-be3ea8d51662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:39.521340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a551d-310d-41f8-a11d-48eca77776aa admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:39.525343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:39.526140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:39.526511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:39.526851 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:39.538352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:39.539030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:39.542217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c84c01-d8b9-4ce2-a26d-be3ea8d51662 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:39.546321 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e645e10-646a-446d-937b-23df81695d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:39.547292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e645e10-646a-446d-937b-23df81695d09 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:39.547642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e645e10-646a-446d-937b-23df81695d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:39.548491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e645e10-646a-446d-937b-23df81695d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:39.550500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1e645e10-646a-446d-937b-23df81695d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:39.554677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1272/2584] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:49:39.561336 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e645e10-646a-446d-937b-23df81695d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:39.563035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e645e10-646a-446d-937b-23df81695d09 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:39.573898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1313/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:40.303121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:40.304762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:40.318227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4725ec9-276d-4aac-bff8-d4f266a153ae service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:40.323496 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:40.324160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.324439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.324712 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] PATH_INFO: `/v3/projects/07800216f18447f9bb1c733fa7235e96` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.325876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07800216f18447f9bb1c733fa7235e96)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:40.328009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:40.385491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:40.391361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07800216f18447f9bb1c733fa7235e96', 'request_id': 'req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:40.401178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07800216f18447f9bb1c733fa7235e96', 'request_id': 'req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:40.411349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07800216f18447f9bb1c733fa7235e96', 'request_id': 'req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:40.425363 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] The token cache is being invalidate because project 07800216f18447f9bb1c733fa7235e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:49:40.425660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:40.426410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-68fbaecd-c0ce-4952-bcfd-29d0cfc7041b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:40.427989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1273/2586] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:49:40 2022] DELETE /identity/v3/projects/07800216f18447f9bb1c733fa7235e96 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:40.433111 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174cf0f-57e1-4b81-8fcf-77a4f001fa38 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.433625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174cf0f-57e1-4b81-8fcf-77a4f001fa38 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.433625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174cf0f-57e1-4b81-8fcf-77a4f001fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.454346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9174cf0f-57e1-4b81-8fcf-77a4f001fa38 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:40.455598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9174cf0f-57e1-4b81-8fcf-77a4f001fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:40.518038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1314/2587] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:40.525922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd9d6c-f4df-46ff-bed7-f0d351198d18 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.526214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd9d6c-f4df-46ff-bed7-f0d351198d18 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.526524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd9d6c-f4df-46ff-bed7-f0d351198d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.547379 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b6bd9d6c-f4df-46ff-bed7-f0d351198d18 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:40.548972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b6bd9d6c-f4df-46ff-bed7-f0d351198d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:40.558202 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1274/2588] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:40.562815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174cf0f-57e1-4b81-8fcf-77a4f001fa38 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:40.573741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174cf0f-57e1-4b81-8fcf-77a4f001fa38 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:40.579902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:40.580700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.580982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.581380 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.582177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:49:40.582513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:40.584165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:40.597659 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1315/2589] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:49:40.602551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd9d6c-f4df-46ff-bed7-f0d351198d18 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:40.612967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd9d6c-f4df-46ff-bed7-f0d351198d18 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:40.619309 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b27cf9-805e-49fe-9157-61ead357fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:40.619923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b27cf9-805e-49fe-9157-61ead357fc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.620204 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b27cf9-805e-49fe-9157-61ead357fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.620493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b27cf9-805e-49fe-9157-61ead357fc9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.621099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b27cf9-805e-49fe-9157-61ead357fc9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:40.623052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b27cf9-805e-49fe-9157-61ead357fc9f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:40.655062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1275/2590] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:49:40 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:40.659835 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:40.670346 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88becbde-b980-43f7-804a-2ffc9ff4214c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:40.731212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:40.742973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cd7e8-80d2-4772-a7a2-325b4fc02e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:40.743606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cd7e8-80d2-4772-a7a2-325b4fc02e1b admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.743890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cd7e8-80d2-4772-a7a2-325b4fc02e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.744161 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cd7e8-80d2-4772-a7a2-325b4fc02e1b admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.744838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cd7e8-80d2-4772-a7a2-325b4fc02e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:40.746846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cd7e8-80d2-4772-a7a2-325b4fc02e1b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:40.774141 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1316/2591] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:49:40 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:40.778908 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b27cf9-805e-49fe-9157-61ead357fc9f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:40.790348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b27cf9-805e-49fe-9157-61ead357fc9f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:40.796007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067caf7-9508-4ab0-a27d-e277c3b5ba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:40.796813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067caf7-9508-4ab0-a27d-e277c3b5ba7f admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.797088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067caf7-9508-4ab0-a27d-e277c3b5ba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.797381 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067caf7-9508-4ab0-a27d-e277c3b5ba7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.798686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067caf7-9508-4ab0-a27d-e277c3b5ba7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:40.800506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067caf7-9508-4ab0-a27d-e277c3b5ba7f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:40.813451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1276/2592] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:40.818804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cd7e8-80d2-4772-a7a2-325b4fc02e1b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:40.829831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cd7e8-80d2-4772-a7a2-325b4fc02e1b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:40.835193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0847f-9165-4a6e-8f18-bf551afc62b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:40.835797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0847f-9165-4a6e-8f18-bf551afc62b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.836072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0847f-9165-4a6e-8f18-bf551afc62b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.836338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0847f-9165-4a6e-8f18-bf551afc62b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.836978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0847f-9165-4a6e-8f18-bf551afc62b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:40.838626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0847f-9165-4a6e-8f18-bf551afc62b8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:40.850308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1317/2593] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:40.854797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067caf7-9508-4ab0-a27d-e277c3b5ba7f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:40.868270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067caf7-9508-4ab0-a27d-e277c3b5ba7f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:40.873285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:40.873978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.874280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.874596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] PATH_INFO: `/v3/projects/670b4754f9964d4d902ca88fe2a61f44/users/580a12f8b1824561af41da8368cbe44c/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.891642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670b4754f9964d4d902ca88fe2a61f44, user_id=580a12f8b1824561af41da8368cbe44c, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:40.894316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:40.909522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1277/2594] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:49:40 2022] PUT /identity/v3/projects/670b4754f9964d4d902ca88fe2a61f44/users/580a12f8b1824561af41da8368cbe44c/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:40.921419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938b174-c761-47c1-b556-7118706c6d87 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:40.921699 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938b174-c761-47c1-b556-7118706c6d87 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:40.921980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938b174-c761-47c1-b556-7118706c6d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:40.952211 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-3938b174-c761-47c1-b556-7118706c6d87 None None] MFA Rules not processed for user `580a12f8b1824561af41da8368cbe44c`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:40.954236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3938b174-c761-47c1-b556-7118706c6d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:41.028477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1318/2595] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:41.036753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:41.038588 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:41.106749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3e49f-a9d8-448b-9e90-455419a44eb7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:41.111322 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:41.112161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:41.112301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:41.112578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:41.122644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:41.124227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:41.134179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1278/2596] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:42.562572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1db91-425d-4763-8b16-fd6d003ded10 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:42.563206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1db91-425d-4763-8b16-fd6d003ded10 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:42.563206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1db91-425d-4763-8b16-fd6d003ded10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:42.586876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-1de1db91-425d-4763-8b16-fd6d003ded10 None None] MFA Rules not processed for user `580a12f8b1824561af41da8368cbe44c`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:42.588073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1de1db91-425d-4763-8b16-fd6d003ded10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:42.596632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1319/2597] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:42.756619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:42.758061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:42.861404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebfc38-087e-4e54-884e-088d7110e5ac service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:42.867856 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:42.868521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:42.868849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:42.870031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:42.872009 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:42.885066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:42.888874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:42.891387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:42.915448 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1279/2598] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:43.185448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1db91-425d-4763-8b16-fd6d003ded10 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:43.187851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-1de1db91-425d-4763-8b16-fd6d003ded10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:43.306996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1db91-425d-4763-8b16-fd6d003ded10 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:43.312734 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1bc2c-c96c-4a5c-aaa8-1b8136551f73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:43.313423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1bc2c-c96c-4a5c-aaa8-1b8136551f73 service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:43.313774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1bc2c-c96c-4a5c-aaa8-1b8136551f73 service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:43.314045 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1bc2c-c96c-4a5c-aaa8-1b8136551f73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:43.316563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3ef1bc2c-c96c-4a5c-aaa8-1b8136551f73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:43.332252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1bc2c-c96c-4a5c-aaa8-1b8136551f73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:43.339208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1bc2c-c96c-4a5c-aaa8-1b8136551f73 service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:43.359451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1320/2599] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:49.417072 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:49.417785 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:49.493473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e25eb-3965-46e7-a373-e55ed02a2572 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:49.497168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:49.497792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:49.498133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:49.498449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:49.501102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:49.580570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:49.582118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:49.593810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1280/2600] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:49.606731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a467-8e16-4c2a-8a52-091bea1a0f49 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:49.607286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a467-8e16-4c2a-8a52-091bea1a0f49 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:49.607521 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7a467-8e16-4c2a-8a52-091bea1a0f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:49.628610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-4db7a467-8e16-4c2a-8a52-091bea1a0f49 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:49.629842 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4db7a467-8e16-4c2a-8a52-091bea1a0f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:49.674485 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:49.695349 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1321/2601] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:49.709380 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:49.710996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:49.788811 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdaced-be0e-4e0b-be5d-6a65f237e1eb service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:49.797071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:49.798094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:49.798481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:49.798823 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:49.809334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:49.811196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:49.822110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1281/2602] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:49:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:49:52.460746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7a467-8e16-4c2a-8a52-091bea1a0f49 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:52.462878 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4db7a467-8e16-4c2a-8a52-091bea1a0f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:52.495496 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7a467-8e16-4c2a-8a52-091bea1a0f49 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:52.513281 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:52.514192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:52.514709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:52.515223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:52.517643 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:52.534809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:52.536682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:52.561244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1322/2603] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:54.826395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:54.828818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:54.847264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499f21b-e730-4176-9213-e37c24304e2c service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:54.859844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:54.860703 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:54.861084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:54.861462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] PATH_INFO: `/v3/users/98468f7877eb48889976ecba85a776ef` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:54.863345 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98468f7877eb48889976ecba85a776ef)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:54.865730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:54.954258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:55.010413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98468f7877eb48889976ecba85a776ef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.022843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98468f7877eb48889976ecba85a776ef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.032468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98468f7877eb48889976ecba85a776ef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.033586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98468f7877eb48889976ecba85a776ef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.034196 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ee53a94d-7fd6-4448-a44b-d56c0d744190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98468f7877eb48889976ecba85a776ef'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.052213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1282/2604] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:49:54 2022] DELETE /identity/v3/users/98468f7877eb48889976ecba85a776ef => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:55.647399 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:55.672762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c3992-ce1d-47bb-bd06-ce653de68de0 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:55.795034 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:55.795404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:55.795698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:55.795981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] PATH_INFO: `/v3/projects/c07d03c1dfb94639985ba1f30cadc3b5` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:55.797270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07d03c1dfb94639985ba1f30cadc3b5)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:55.800180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:55.860279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07d03c1dfb94639985ba1f30cadc3b5', 'request_id': 'req-f75677b2-0be2-4fc8-acca-3051199fa3bc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.868214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07d03c1dfb94639985ba1f30cadc3b5', 'request_id': 'req-f75677b2-0be2-4fc8-acca-3051199fa3bc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.877972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07d03c1dfb94639985ba1f30cadc3b5', 'request_id': 'req-f75677b2-0be2-4fc8-acca-3051199fa3bc'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.893909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] The token cache is being invalidate because project c07d03c1dfb94639985ba1f30cadc3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:49:55.894239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.895064 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-f75677b2-0be2-4fc8-acca-3051199fa3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:49:55.898492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1323/2605] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:49:55 2022] DELETE /identity/v3/projects/c07d03c1dfb94639985ba1f30cadc3b5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:55.901984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae10dd9-a55a-4c4b-9868-098a835e547f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:55.902628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae10dd9-a55a-4c4b-9868-098a835e547f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:55.902628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae10dd9-a55a-4c4b-9868-098a835e547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:55.930880 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0ae10dd9-a55a-4c4b-9868-098a835e547f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:55.935930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0ae10dd9-a55a-4c4b-9868-098a835e547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:56.042831 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1283/2606] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:56.049177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd9f8-8813-4466-94b8-8389920a0782 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.049479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd9f8-8813-4466-94b8-8389920a0782 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.049913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd9f8-8813-4466-94b8-8389920a0782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.091838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-635cd9f8-8813-4466-94b8-8389920a0782 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:56.093850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-635cd9f8-8813-4466-94b8-8389920a0782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:56.120263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1324/2607] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:56.125042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae10dd9-a55a-4c4b-9868-098a835e547f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:56.142540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae10dd9-a55a-4c4b-9868-098a835e547f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:56.148063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:56.148784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.149145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.149482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.150509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:49:56.151728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:56.153066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:56.168013 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1284/2608] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:49:56.172786 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cd9f8-8813-4466-94b8-8389920a0782 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:56.186009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cd9f8-8813-4466-94b8-8389920a0782 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:56.196977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4a94-55ee-41c5-9edb-f146c0f307ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:56.198055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4a94-55ee-41c5-9edb-f146c0f307ba admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.199191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4a94-55ee-41c5-9edb-f146c0f307ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.199655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4a94-55ee-41c5-9edb-f146c0f307ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.203096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca4a94-55ee-41c5-9edb-f146c0f307ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:56.206459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca4a94-55ee-41c5-9edb-f146c0f307ba admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:56.262435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1325/2609] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:49:56 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:56.265442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:56.276036 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2beb83-7ca6-40fd-b6ef-5a2423a6f176 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:56.370787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c75324-161d-474c-83e1-36091d68aef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:56.371587 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75324-161d-474c-83e1-36091d68aef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.371932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75324-161d-474c-83e1-36091d68aef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.372145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75324-161d-474c-83e1-36091d68aef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.373033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c75324-161d-474c-83e1-36091d68aef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:56.375099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c75324-161d-474c-83e1-36091d68aef8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:56.435387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1285/2610] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:49:56 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:56.440286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4a94-55ee-41c5-9edb-f146c0f307ba admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:56.453384 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4a94-55ee-41c5-9edb-f146c0f307ba admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:56.458392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27cd7a-d17c-4b75-be2e-8db807622709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:56.459130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cd7a-d17c-4b75-be2e-8db807622709 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.459469 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cd7a-d17c-4b75-be2e-8db807622709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.460051 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cd7a-d17c-4b75-be2e-8db807622709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.460787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27cd7a-d17c-4b75-be2e-8db807622709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:56.462565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27cd7a-d17c-4b75-be2e-8db807622709 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:56.474908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1326/2611] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:56.478829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c75324-161d-474c-83e1-36091d68aef8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:56.489832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c75324-161d-474c-83e1-36091d68aef8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:56.495300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d489360-1849-4e62-8763-e85b930257c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:56.496026 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489360-1849-4e62-8763-e85b930257c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.496369 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489360-1849-4e62-8763-e85b930257c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.496708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489360-1849-4e62-8763-e85b930257c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.497425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d489360-1849-4e62-8763-e85b930257c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:56.504289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d489360-1849-4e62-8763-e85b930257c3 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:56.517078 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1286/2612] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:56.525023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27cd7a-d17c-4b75-be2e-8db807622709 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:56.538821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27cd7a-d17c-4b75-be2e-8db807622709 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:56.545376 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5060-d596-48a6-a561-9fe4575fcf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:56.546630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5060-d596-48a6-a561-9fe4575fcf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.546909 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5060-d596-48a6-a561-9fe4575fcf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.547172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5060-d596-48a6-a561-9fe4575fcf64 admin admin] PATH_INFO: `/v3/projects/5066209e6d6c4ccba5868e6b4d991b61/users/45c858af6e394e679a5febc8e55c3b34/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.563749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5060-d596-48a6-a561-9fe4575fcf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5066209e6d6c4ccba5868e6b4d991b61, user_id=45c858af6e394e679a5febc8e55c3b34, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:56.566402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5060-d596-48a6-a561-9fe4575fcf64 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:56.583843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1327/2613] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:49:56 2022] PUT /identity/v3/projects/5066209e6d6c4ccba5868e6b4d991b61/users/45c858af6e394e679a5febc8e55c3b34/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:56.595241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb7a8-56f0-4e52-a230-8cf4747f4438 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.595508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb7a8-56f0-4e52-a230-8cf4747f4438 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.595786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb7a8-56f0-4e52-a230-8cf4747f4438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.633150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:56.639250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f35bb7a8-56f0-4e52-a230-8cf4747f4438 None None] MFA Rules not processed for user `45c858af6e394e679a5febc8e55c3b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:56.641727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f35bb7a8-56f0-4e52-a230-8cf4747f4438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:56.750752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1287/2614] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:56.755670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5060-d596-48a6-a561-9fe4575fcf64 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:56.766022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:56.845084 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5060-d596-48a6-a561-9fe4575fcf64 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:56.854218 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f048cd-d176-47bc-9c64-1bef727807a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:56.855162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f048cd-d176-47bc-9c64-1bef727807a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:56.855443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f048cd-d176-47bc-9c64-1bef727807a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:56.855798 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f048cd-d176-47bc-9c64-1bef727807a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:56.856483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f048cd-d176-47bc-9c64-1bef727807a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:56.859288 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f048cd-d176-47bc-9c64-1bef727807a8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:56.898550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1328/2615] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:49:56 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:49:56.902392 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb7a8-56f0-4e52-a230-8cf4747f4438 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:56.913948 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb7a8-56f0-4e52-a230-8cf4747f4438 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:57.011952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94215b7-0f15-414d-81f2-ff15c3f96e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:57.012890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94215b7-0f15-414d-81f2-ff15c3f96e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.013347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94215b7-0f15-414d-81f2-ff15c3f96e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.013778 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94215b7-0f15-414d-81f2-ff15c3f96e2e admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.014708 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94215b7-0f15-414d-81f2-ff15c3f96e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:57.017100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94215b7-0f15-414d-81f2-ff15c3f96e2e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:57.056554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1288/2616] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:49:56 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:49:57.063356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f048cd-d176-47bc-9c64-1bef727807a8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:57.074572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f048cd-d176-47bc-9c64-1bef727807a8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:57.080544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21487b4-9812-4bbc-aff8-489bc9ab1031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:57.081542 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21487b4-9812-4bbc-aff8-489bc9ab1031 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.081984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21487b4-9812-4bbc-aff8-489bc9ab1031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.082477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21487b4-9812-4bbc-aff8-489bc9ab1031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.083288 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21487b4-9812-4bbc-aff8-489bc9ab1031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:57.085473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21487b4-9812-4bbc-aff8-489bc9ab1031 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:57.098488 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1329/2617] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:57.102412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94215b7-0f15-414d-81f2-ff15c3f96e2e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:57.114508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94215b7-0f15-414d-81f2-ff15c3f96e2e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:57.119871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4ff09-899e-4b39-823d-4f5b05053110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:57.120570 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ff09-899e-4b39-823d-4f5b05053110 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.120852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ff09-899e-4b39-823d-4f5b05053110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.121126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4ff09-899e-4b39-823d-4f5b05053110 admin admin] PATH_INFO: `/v3/projects/cdfadc5e5d824f518e47f4cf12faf4d9/users/c52e77ff38c943b0884830becd753f7a/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.141141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4ff09-899e-4b39-823d-4f5b05053110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfadc5e5d824f518e47f4cf12faf4d9, user_id=c52e77ff38c943b0884830becd753f7a, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:57.143894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4ff09-899e-4b39-823d-4f5b05053110 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:57.180743 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1289/2618] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:49:57 2022] PUT /identity/v3/projects/cdfadc5e5d824f518e47f4cf12faf4d9/users/c52e77ff38c943b0884830becd753f7a/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:57.181008 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21487b4-9812-4bbc-aff8-489bc9ab1031 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:57.200773 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21487b4-9812-4bbc-aff8-489bc9ab1031 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:57.275864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab00d5-85be-4cbc-aa55-85a31f1d83b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:57.275864 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab00d5-85be-4cbc-aa55-85a31f1d83b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.276252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab00d5-85be-4cbc-aa55-85a31f1d83b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.276585 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab00d5-85be-4cbc-aa55-85a31f1d83b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.277292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab00d5-85be-4cbc-aa55-85a31f1d83b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:57.285628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab00d5-85be-4cbc-aa55-85a31f1d83b4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:57.302176 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4ff09-899e-4b39-823d-4f5b05053110 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:57.303305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1330/2619] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:49:57.321958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4ff09-899e-4b39-823d-4f5b05053110 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:57.345747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:57.346592 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.347612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.347895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] PATH_INFO: `/v3/projects/cdfadc5e5d824f518e47f4cf12faf4d9/users/c52e77ff38c943b0884830becd753f7a/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.350094 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfadc5e5d824f518e47f4cf12faf4d9, user_id=c52e77ff38c943b0884830becd753f7a, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:57.353247 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:57.378912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1290/2620] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:49:57 2022] PUT /identity/v3/projects/cdfadc5e5d824f518e47f4cf12faf4d9/users/c52e77ff38c943b0884830becd753f7a/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:49:57.381578 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8f4b-e2e5-4ad8-bad1-67633e6090e8 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.381978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8f4b-e2e5-4ad8-bad1-67633e6090e8 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.382338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8f4b-e2e5-4ad8-bad1-67633e6090e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.428459 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7a6a8f4b-e2e5-4ad8-bad1-67633e6090e8 None None] MFA Rules not processed for user `c52e77ff38c943b0884830becd753f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:49:57.429707 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7a6a8f4b-e2e5-4ad8-bad1-67633e6090e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:57.538820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:57.543159 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1331/2621] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:49:57.555809 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:57.557505 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:49:57.637474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc727b1e-8be0-401f-ab01-c27d9c51a119 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:57.642275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8653c-55a0-4e1d-8238-94ecf111b1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:57.642997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8653c-55a0-4e1d-8238-94ecf111b1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.643271 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8653c-55a0-4e1d-8238-94ecf111b1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.643535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8653c-55a0-4e1d-8238-94ecf111b1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.654625 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8653c-55a0-4e1d-8238-94ecf111b1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:57.656264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8653c-55a0-4e1d-8238-94ecf111b1c1 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:57.660704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:57.668269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1291/2622] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:49:57.761368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8f4b-e2e5-4ad8-bad1-67633e6090e8 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:49:57.771737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8f4b-e2e5-4ad8-bad1-67633e6090e8 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:49:57.775411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987574b-1a9f-4a51-993a-1e4d8335acce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:49:57.776046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987574b-1a9f-4a51-993a-1e4d8335acce service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:49:57.776297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987574b-1a9f-4a51-993a-1e4d8335acce service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:49:57.776566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987574b-1a9f-4a51-993a-1e4d8335acce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:49:57.844098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987574b-1a9f-4a51-993a-1e4d8335acce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:49:57.845767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987574b-1a9f-4a51-993a-1e4d8335acce service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:49:57.856322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1332/2623] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:04.924295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8653c-55a0-4e1d-8238-94ecf111b1c1 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:04.991674 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8653c-55a0-4e1d-8238-94ecf111b1c1 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:05.003814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:05.004719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.004997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.005310 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] PATH_INFO: `/v3/users/45c858af6e394e679a5febc8e55c3b34` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.006614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c858af6e394e679a5febc8e55c3b34)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:05.008601 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:05.037150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb54c5c-ef9b-4e57-a969-ea727af3ea0d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.037696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb54c5c-ef9b-4e57-a969-ea727af3ea0d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.037696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb54c5c-ef9b-4e57-a969-ea727af3ea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.061016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5cb54c5c-ef9b-4e57-a969-ea727af3ea0d None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:05.063107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5cb54c5c-ef9b-4e57-a969-ea727af3ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:05.067590 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c858af6e394e679a5febc8e55c3b34'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.082014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c858af6e394e679a5febc8e55c3b34'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.090142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c858af6e394e679a5febc8e55c3b34'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.090958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c858af6e394e679a5febc8e55c3b34'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.091549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-042434a9-16d2-4a7c-9dac-d02be341b0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c858af6e394e679a5febc8e55c3b34'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.109126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1292/2624] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:04 2022] DELETE /identity/v3/users/45c858af6e394e679a5febc8e55c3b34 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:05.114556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2040-1c78-4df6-a594-de7f20e58900 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.114874 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2040-1c78-4df6-a594-de7f20e58900 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.115111 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2040-1c78-4df6-a594-de7f20e58900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.125293 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1333/2625] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:05.135902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-111c2040-1c78-4df6-a594-de7f20e58900 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:05.137136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-111c2040-1c78-4df6-a594-de7f20e58900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:05.140730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb54c5c-ef9b-4e57-a969-ea727af3ea0d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:05.142656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5cb54c5c-ef9b-4e57-a969-ea727af3ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:05.207665 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1293/2626] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:05.221524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c2040-1c78-4df6-a594-de7f20e58900 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:05.223256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-111c2040-1c78-4df6-a594-de7f20e58900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:05.223846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb54c5c-ef9b-4e57-a969-ea727af3ea0d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:05.256635 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:05.291193 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:05.317954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e9a3a-fa63-4bbe-90d8-c857294f3299 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:05.318777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e9a3a-fa63-4bbe-90d8-c857294f3299 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.319121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e9a3a-fa63-4bbe-90d8-c857294f3299 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.319449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e9a3a-fa63-4bbe-90d8-c857294f3299 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.323921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c2040-1c78-4df6-a594-de7f20e58900 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:05.329479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46be1d-486d-4a5a-849c-487e8305333c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:05.330276 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46be1d-486d-4a5a-849c-487e8305333c service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.330654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46be1d-486d-4a5a-849c-487e8305333c service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.330996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46be1d-486d-4a5a-849c-487e8305333c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.343604 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46be1d-486d-4a5a-849c-487e8305333c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:05.345643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46be1d-486d-4a5a-849c-487e8305333c service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:05.367780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1294/2627] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:05.399265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e9a3a-fa63-4bbe-90d8-c857294f3299 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:05.400895 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e9a3a-fa63-4bbe-90d8-c857294f3299 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:05.417526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1334/2628] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:50:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:50:05.630472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e0f5-233a-404f-ae5a-50856aa5142d None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.631291 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e0f5-233a-404f-ae5a-50856aa5142d None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.631568 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e0f5-233a-404f-ae5a-50856aa5142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.656378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-dbd8e0f5-233a-404f-ae5a-50856aa5142d None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:05.657782 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dbd8e0f5-233a-404f-ae5a-50856aa5142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:05.670959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1295/2629] 10.222.0.49 () {58 vars in 967 bytes} [Tue Aug 30 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:05.686283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e9a3a-fa63-4bbe-90d8-c857294f3299 service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:05.694683 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8e0f5-233a-404f-ae5a-50856aa5142d None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:05.696513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-dbd8e0f5-233a-404f-ae5a-50856aa5142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:05.703392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e9a3a-fa63-4bbe-90d8-c857294f3299 service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:05.710073 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781492-4806-47a1-9044-607309923ec6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:05.710738 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781492-4806-47a1-9044-607309923ec6 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.711016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781492-4806-47a1-9044-607309923ec6 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.711288 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd781492-4806-47a1-9044-607309923ec6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.719003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8e0f5-233a-404f-ae5a-50856aa5142d None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:05.726459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:05.727644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.728096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.728586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] PATH_INFO: `/v3/projects/5066209e6d6c4ccba5868e6b4d991b61` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.729846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5066209e6d6c4ccba5868e6b4d991b61)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:05.732185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:05.732309 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781492-4806-47a1-9044-607309923ec6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:05.734532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd781492-4806-47a1-9044-607309923ec6 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:05.744360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1335/2630] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:50:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:50:05.792812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5066209e6d6c4ccba5868e6b4d991b61', 'request_id': 'req-674ab6e7-f6f6-4535-ab02-bc1ada68d971'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.800854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5066209e6d6c4ccba5868e6b4d991b61', 'request_id': 'req-674ab6e7-f6f6-4535-ab02-bc1ada68d971'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.812048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5066209e6d6c4ccba5868e6b4d991b61', 'request_id': 'req-674ab6e7-f6f6-4535-ab02-bc1ada68d971'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.839984 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] The token cache is being invalidate because project 5066209e6d6c4ccba5868e6b4d991b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:05.840331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.841081 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-674ab6e7-f6f6-4535-ab02-bc1ada68d971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:05.843290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1296/2631] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:05 2022] DELETE /identity/v3/projects/5066209e6d6c4ccba5868e6b4d991b61 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:05.847391 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781492-4806-47a1-9044-607309923ec6 service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:05.858892 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd781492-4806-47a1-9044-607309923ec6 service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:05.931037 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:05.931702 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:05.931978 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:05.932251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] PATH_INFO: `/v3/users/c52e77ff38c943b0884830becd753f7a` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:05.933455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52e77ff38c943b0884830becd753f7a)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:05.935428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:05.991863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52e77ff38c943b0884830becd753f7a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.007634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52e77ff38c943b0884830becd753f7a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.008597 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52e77ff38c943b0884830becd753f7a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.009303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52e77ff38c943b0884830becd753f7a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.011684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94492b-7679-4138-9ed0-ccd680e4ace9 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.012167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94492b-7679-4138-9ed0-ccd680e4ace9 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.012301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94492b-7679-4138-9ed0-ccd680e4ace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.019484 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52e77ff38c943b0884830becd753f7a'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.024796 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:06.035416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1336/2632] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:05 2022] DELETE /identity/v3/users/c52e77ff38c943b0884830becd753f7a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:50:06.039437 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6c94492b-7679-4138-9ed0-ccd680e4ace9 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:06.041406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6c94492b-7679-4138-9ed0-ccd680e4ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.111925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1297/2633] 10.222.0.49 () {58 vars in 967 bytes} [Tue Aug 30 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:06.125818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:06.127583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.211613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e373-c4d9-4357-8edc-c6628adc605b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:06.217590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0179dd-73a7-4e36-9fbb-e26db24c791d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:06.218145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0179dd-73a7-4e36-9fbb-e26db24c791d service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.218452 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0179dd-73a7-4e36-9fbb-e26db24c791d service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.218728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0179dd-73a7-4e36-9fbb-e26db24c791d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.229032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0179dd-73a7-4e36-9fbb-e26db24c791d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:06.230682 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0179dd-73a7-4e36-9fbb-e26db24c791d service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:06.240279 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1337/2634] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:50:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:50:06.377061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94492b-7679-4138-9ed0-ccd680e4ace9 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:06.379646 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6c94492b-7679-4138-9ed0-ccd680e4ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.446767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:06.479436 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94492b-7679-4138-9ed0-ccd680e4ace9 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:06.485174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:06.485844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.486116 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.486504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] PATH_INFO: `/v3/projects/cdfadc5e5d824f518e47f4cf12faf4d9` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.487616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfadc5e5d824f518e47f4cf12faf4d9)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:06.489739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:06.560015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73fbd4-a3ca-4ac9-83fb-fa82c59252da None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.560269 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73fbd4-a3ca-4ac9-83fb-fa82c59252da None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.560536 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73fbd4-a3ca-4ac9-83fb-fa82c59252da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.563770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfadc5e5d824f518e47f4cf12faf4d9', 'request_id': 'req-3c552e41-f811-44fa-9082-edb6a647ef58'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.572235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfadc5e5d824f518e47f4cf12faf4d9', 'request_id': 'req-3c552e41-f811-44fa-9082-edb6a647ef58'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.582685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfadc5e5d824f518e47f4cf12faf4d9', 'request_id': 'req-3c552e41-f811-44fa-9082-edb6a647ef58'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.589897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fb73fbd4-a3ca-4ac9-83fb-fa82c59252da None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:06.591175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fb73fbd4-a3ca-4ac9-83fb-fa82c59252da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.597216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] The token cache is being invalidate because project cdfadc5e5d824f518e47f4cf12faf4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:06.598353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.599596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3c552e41-f811-44fa-9082-edb6a647ef58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:06.602468 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1298/2635] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:06 2022] DELETE /identity/v3/projects/cdfadc5e5d824f518e47f4cf12faf4d9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:06.609209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19266a-6e64-4979-be69-51f25be26213 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.609558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19266a-6e64-4979-be69-51f25be26213 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.609893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19266a-6e64-4979-be69-51f25be26213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.631255 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ac19266a-6e64-4979-be69-51f25be26213 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:06.632482 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ac19266a-6e64-4979-be69-51f25be26213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.656447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1338/2636] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:06.670836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73fbd4-a3ca-4ac9-83fb-fa82c59252da None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:06.672698 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fb73fbd4-a3ca-4ac9-83fb-fa82c59252da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.695099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1299/2637] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:06.703279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2544cd1-0e7e-4b18-9129-10124482f029 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.703561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2544cd1-0e7e-4b18-9129-10124482f029 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.703832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2544cd1-0e7e-4b18-9129-10124482f029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.723520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e2544cd1-0e7e-4b18-9129-10124482f029 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:06.724728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e2544cd1-0e7e-4b18-9129-10124482f029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:06.732659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1300/2638] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:06.736887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2544cd1-0e7e-4b18-9129-10124482f029 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:06.745096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73fbd4-a3ca-4ac9-83fb-fa82c59252da None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:06.746623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2544cd1-0e7e-4b18-9129-10124482f029 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:06.750667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8eaa-8aa6-4b83-bbb3-4dbd2dc11ddb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:06.751285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8eaa-8aa6-4b83-bbb3-4dbd2dc11ddb service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.751561 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8eaa-8aa6-4b83-bbb3-4dbd2dc11ddb service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.751844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8eaa-8aa6-4b83-bbb3-4dbd2dc11ddb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.752024 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:06.752689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.752965 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.753233 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.753863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:50:06.754163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:06.755858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:06.760265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8eaa-8aa6-4b83-bbb3-4dbd2dc11ddb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:06.761838 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8eaa-8aa6-4b83-bbb3-4dbd2dc11ddb service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:06.773326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1301/2639] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:50:06.774087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1339/2640] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:50:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:50:06.774473 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:06.786343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d5a41-e8a2-4bea-b14c-7b30836fb2ba admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:06.791743 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec4fb-b2a6-4874-b592-5036f10c360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:06.792312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec4fb-b2a6-4874-b592-5036f10c360a admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.792611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec4fb-b2a6-4874-b592-5036f10c360a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.792884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec4fb-b2a6-4874-b592-5036f10c360a admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.793516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ec4fb-b2a6-4874-b592-5036f10c360a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:06.795608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ec4fb-b2a6-4874-b592-5036f10c360a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:06.829891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1302/2641] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:06 2022] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:50:06.834501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8eaa-8aa6-4b83-bbb3-4dbd2dc11ddb service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:06.845372 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8eaa-8aa6-4b83-bbb3-4dbd2dc11ddb service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:06.860075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:06.916274 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daeed5-98a4-4bc2-a02f-0e64a21cf6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:06.916928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daeed5-98a4-4bc2-a02f-0e64a21cf6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.917210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daeed5-98a4-4bc2-a02f-0e64a21cf6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.917628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daeed5-98a4-4bc2-a02f-0e64a21cf6b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.918300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daeed5-98a4-4bc2-a02f-0e64a21cf6b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:06.920297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daeed5-98a4-4bc2-a02f-0e64a21cf6b1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:06.948200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1340/2642] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:06 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:06.953439 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec4fb-b2a6-4874-b592-5036f10c360a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:06.965550 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec4fb-b2a6-4874-b592-5036f10c360a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:06.972136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0577a11-d928-49cd-9b2e-bb295a9d0e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:06.972533 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0577a11-d928-49cd-9b2e-bb295a9d0e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:06.972825 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0577a11-d928-49cd-9b2e-bb295a9d0e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:06.973168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0577a11-d928-49cd-9b2e-bb295a9d0e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:06.973958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0577a11-d928-49cd-9b2e-bb295a9d0e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:06.975519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0577a11-d928-49cd-9b2e-bb295a9d0e72 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:06.990484 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1303/2643] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:06.991917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daeed5-98a4-4bc2-a02f-0e64a21cf6b1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.003225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daeed5-98a4-4bc2-a02f-0e64a21cf6b1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.009002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e575f-913e-471c-a431-372b5c461212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.009679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e575f-913e-471c-a431-372b5c461212 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.009963 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e575f-913e-471c-a431-372b5c461212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.010233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e575f-913e-471c-a431-372b5c461212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.010931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e575f-913e-471c-a431-372b5c461212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.012987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e575f-913e-471c-a431-372b5c461212 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.027006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1341/2644] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:07.031671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0577a11-d928-49cd-9b2e-bb295a9d0e72 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.044638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0577a11-d928-49cd-9b2e-bb295a9d0e72 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.053090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a37ce-3d32-4487-8933-ea4b07953530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.053834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a37ce-3d32-4487-8933-ea4b07953530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.054242 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a37ce-3d32-4487-8933-ea4b07953530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.054704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a37ce-3d32-4487-8933-ea4b07953530 admin admin] PATH_INFO: `/v3/projects/b23233950f864f7c99458b449ceb19a9/users/f13827cbc5bb4ad0ad98f7295dd3a9a3/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.073952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a37ce-3d32-4487-8933-ea4b07953530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23233950f864f7c99458b449ceb19a9, user_id=f13827cbc5bb4ad0ad98f7295dd3a9a3, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.077274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a37ce-3d32-4487-8933-ea4b07953530 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.081084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:07.100953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1304/2645] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:07 2022] PUT /identity/v3/projects/b23233950f864f7c99458b449ceb19a9/users/f13827cbc5bb4ad0ad98f7295dd3a9a3/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:07.113047 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeac08-5822-433f-a48e-52eafae0d25b None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.113333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeac08-5822-433f-a48e-52eafae0d25b None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.113605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeac08-5822-433f-a48e-52eafae0d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.152049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c8eeac08-5822-433f-a48e-52eafae0d25b None None] MFA Rules not processed for user `f13827cbc5bb4ad0ad98f7295dd3a9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:07.153405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c8eeac08-5822-433f-a48e-52eafae0d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:07.165553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3074b-af2c-4440-84c6-78d5d58d6974 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.165843 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3074b-af2c-4440-84c6-78d5d58d6974 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.166121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3074b-af2c-4440-84c6-78d5d58d6974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.189440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fba3074b-af2c-4440-84c6-78d5d58d6974 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:07.190715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fba3074b-af2c-4440-84c6-78d5d58d6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:07.236668 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1342/2646] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:07.241256 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eeac08-5822-433f-a48e-52eafae0d25b None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.264691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1305/2647] 10.222.0.49 () {58 vars in 967 bytes} [Tue Aug 30 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:07.279407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3074b-af2c-4440-84c6-78d5d58d6974 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.321926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eeac08-5822-433f-a48e-52eafae0d25b None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.327775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970fca6-71b6-47d8-9e82-b1fd284c6806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.328415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970fca6-71b6-47d8-9e82-b1fd284c6806 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.328687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970fca6-71b6-47d8-9e82-b1fd284c6806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.329130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970fca6-71b6-47d8-9e82-b1fd284c6806 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.329767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970fca6-71b6-47d8-9e82-b1fd284c6806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.331728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970fca6-71b6-47d8-9e82-b1fd284c6806 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.364224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1343/2648] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:07 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:50:07.369360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3074b-af2c-4440-84c6-78d5d58d6974 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.369694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970fca6-71b6-47d8-9e82-b1fd284c6806 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.387626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:07.454032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970fca6-71b6-47d8-9e82-b1fd284c6806 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.454340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d4fb-2982-4882-b5ef-092ba1ecc9c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.455016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d4fb-2982-4882-b5ef-092ba1ecc9c7 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.455492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d4fb-2982-4882-b5ef-092ba1ecc9c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.455971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d4fb-2982-4882-b5ef-092ba1ecc9c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.462219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da675a20-f8d5-4c3f-887d-1480f5673ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.463242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675a20-f8d5-4c3f-887d-1480f5673ede admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.463694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675a20-f8d5-4c3f-887d-1480f5673ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.464138 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675a20-f8d5-4c3f-887d-1480f5673ede admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.465200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da675a20-f8d5-4c3f-887d-1480f5673ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.468516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da675a20-f8d5-4c3f-887d-1480f5673ede admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.495389 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1344/2649] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:07 2022] POST /identity/v3/users => generated 307 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:50:07.499439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da675a20-f8d5-4c3f-887d-1480f5673ede admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.510608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da675a20-f8d5-4c3f-887d-1480f5673ede admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.518239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e50f-7aa1-42de-b086-2df1c46ddda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.518894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e50f-7aa1-42de-b086-2df1c46ddda5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.519181 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e50f-7aa1-42de-b086-2df1c46ddda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.519425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8e50f-7aa1-42de-b086-2df1c46ddda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.520107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8e50f-7aa1-42de-b086-2df1c46ddda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.520728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:07.521857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8e50f-7aa1-42de-b086-2df1c46ddda5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.534870 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5d4fb-2982-4882-b5ef-092ba1ecc9c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.535949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1345/2650] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:50:07.536838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5d4fb-2982-4882-b5ef-092ba1ecc9c7 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.541170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e50f-7aa1-42de-b086-2df1c46ddda5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.547547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1306/2651] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:50:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 14:50:07.558875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8e50f-7aa1-42de-b086-2df1c46ddda5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.565286 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0ef3-7e52-4f47-b170-5fcbbc6e1c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.567213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0ef3-7e52-4f47-b170-5fcbbc6e1c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.567213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0ef3-7e52-4f47-b170-5fcbbc6e1c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.567213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0ef3-7e52-4f47-b170-5fcbbc6e1c27 admin admin] PATH_INFO: `/v3/projects/7f758c78b79b45a691df6b4f99161d16/users/619afc91ef58445080becf641db5e722/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.586780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad0ef3-7e52-4f47-b170-5fcbbc6e1c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f758c78b79b45a691df6b4f99161d16, user_id=619afc91ef58445080becf641db5e722, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.589780 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad0ef3-7e52-4f47-b170-5fcbbc6e1c27 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.610401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1346/2652] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:07 2022] PUT /identity/v3/projects/7f758c78b79b45a691df6b4f99161d16/users/619afc91ef58445080becf641db5e722/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:07.614826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d4fb-2982-4882-b5ef-092ba1ecc9c7 service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.626671 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d4fb-2982-4882-b5ef-092ba1ecc9c7 service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.701312 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41c39e-5b0a-4904-808d-81ddfabbf1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.703102 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c39e-5b0a-4904-808d-81ddfabbf1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.703401 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c39e-5b0a-4904-808d-81ddfabbf1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.703752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c39e-5b0a-4904-808d-81ddfabbf1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.704528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41c39e-5b0a-4904-808d-81ddfabbf1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.706283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41c39e-5b0a-4904-808d-81ddfabbf1c2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.720257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1307/2653] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:07.723065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0ef3-7e52-4f47-b170-5fcbbc6e1c27 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.734299 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0ef3-7e52-4f47-b170-5fcbbc6e1c27 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:07.739102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:07.739771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.740044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.740312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] PATH_INFO: `/v3/projects/7f758c78b79b45a691df6b4f99161d16/users/619afc91ef58445080becf641db5e722/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.742929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f758c78b79b45a691df6b4f99161d16, user_id=619afc91ef58445080becf641db5e722, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:07.746280 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:07.764532 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1347/2654] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:07 2022] PUT /identity/v3/projects/7f758c78b79b45a691df6b4f99161d16/users/619afc91ef58445080becf641db5e722/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:07.777739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f220c-5ae7-423e-921d-7063cc54b8ee None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:07.778163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f220c-5ae7-423e-921d-7063cc54b8ee None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:07.778475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f220c-5ae7-423e-921d-7063cc54b8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:07.819855 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-131f220c-5ae7-423e-921d-7063cc54b8ee None None] MFA Rules not processed for user `619afc91ef58445080becf641db5e722`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:07.822597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-131f220c-5ae7-423e-921d-7063cc54b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:07.916530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1308/2655] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:07.932515 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:07.934457 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:08.002315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77ec5d-3c14-4a2b-9e1a-dc7acfe12743 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:08.006681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:08.007318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:08.007598 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:08.007873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:08.022766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:08.024301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:08.038215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1348/2656] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:08.127916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f220c-5ae7-423e-921d-7063cc54b8ee None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:08.129889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-131f220c-5ae7-423e-921d-7063cc54b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:08.144560 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f220c-5ae7-423e-921d-7063cc54b8ee None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:08.148428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400a125-4831-45ce-b63b-485d3f18fc1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:08.149213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a125-4831-45ce-b63b-485d3f18fc1c service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:08.149552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a125-4831-45ce-b63b-485d3f18fc1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:08.149881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a125-4831-45ce-b63b-485d3f18fc1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:08.218172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400a125-4831-45ce-b63b-485d3f18fc1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:08.219700 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400a125-4831-45ce-b63b-485d3f18fc1c service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:08.229866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1309/2657] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:08 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:09.907077 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:09.909460 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:09.982080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:09.991693 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa532d9-dccb-4d40-a602-29b546beabd3 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:09.997212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:09.998187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:09.998712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:09.999097 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] PATH_INFO: `/v3/users/580a12f8b1824561af41da8368cbe44c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.000422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580a12f8b1824561af41da8368cbe44c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:10.002430 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:10.059263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580a12f8b1824561af41da8368cbe44c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.073216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580a12f8b1824561af41da8368cbe44c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.073954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580a12f8b1824561af41da8368cbe44c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.074640 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580a12f8b1824561af41da8368cbe44c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.085790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580a12f8b1824561af41da8368cbe44c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.100423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1349/2658] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:09 2022] DELETE /identity/v3/users/580a12f8b1824561af41da8368cbe44c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:10.105638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f742fe-8234-4e2e-8e7d-7247c769f2cc None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:10.106139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f742fe-8234-4e2e-8e7d-7247c769f2cc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:10.106256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f742fe-8234-4e2e-8e7d-7247c769f2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.118348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:10.133753 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-54f742fe-8234-4e2e-8e7d-7247c769f2cc None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:10.134034 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-54f742fe-8234-4e2e-8e7d-7247c769f2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:10.206147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1310/2659] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:10.217712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:10.219337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:10.282639 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515cc4-f6a2-4e4a-98f7-cabc5a471ff8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:10.286589 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e76dd-aca1-479f-b537-52126ed4a02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:10.287208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e76dd-aca1-479f-b537-52126ed4a02c service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:10.287467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e76dd-aca1-479f-b537-52126ed4a02c service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:10.287745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e76dd-aca1-479f-b537-52126ed4a02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.298551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e76dd-aca1-479f-b537-52126ed4a02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:10.300040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e76dd-aca1-479f-b537-52126ed4a02c service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:10.310775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1350/2660] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:10.517670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f742fe-8234-4e2e-8e7d-7247c769f2cc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:10.519258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-54f742fe-8234-4e2e-8e7d-7247c769f2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:10.532617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f742fe-8234-4e2e-8e7d-7247c769f2cc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:10.537968 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:10.538682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:10.538960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:10.539232 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] PATH_INFO: `/v3/projects/670b4754f9964d4d902ca88fe2a61f44` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.540462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670b4754f9964d4d902ca88fe2a61f44)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:10.542519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:10.596854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670b4754f9964d4d902ca88fe2a61f44', 'request_id': 'req-38704df0-71ca-4e65-becc-2d9cb14083f8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.608096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670b4754f9964d4d902ca88fe2a61f44', 'request_id': 'req-38704df0-71ca-4e65-becc-2d9cb14083f8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.620433 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670b4754f9964d4d902ca88fe2a61f44', 'request_id': 'req-38704df0-71ca-4e65-becc-2d9cb14083f8'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.635376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] The token cache is being invalidate because project 670b4754f9964d4d902ca88fe2a61f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:10.635701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.636651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-38704df0-71ca-4e65-becc-2d9cb14083f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:10.638912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1311/2661] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:10 2022] DELETE /identity/v3/projects/670b4754f9964d4d902ca88fe2a61f44 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:10.644091 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653931c-4bc8-4219-bcb3-25b25714557c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:10.644422 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653931c-4bc8-4219-bcb3-25b25714557c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:10.644704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653931c-4bc8-4219-bcb3-25b25714557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.664771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b653931c-4bc8-4219-bcb3-25b25714557c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:10.665971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b653931c-4bc8-4219-bcb3-25b25714557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:10.733088 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1351/2662] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:10.745511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d1124-27c4-431e-88f0-4e894dde5c31 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:10.745792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d1124-27c4-431e-88f0-4e894dde5c31 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:10.746067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d1124-27c4-431e-88f0-4e894dde5c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.770469 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-161d1124-27c4-431e-88f0-4e894dde5c31 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:10.771617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-161d1124-27c4-431e-88f0-4e894dde5c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:10.780919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1312/2663] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:10.785308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653931c-4bc8-4219-bcb3-25b25714557c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:10.795046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653931c-4bc8-4219-bcb3-25b25714557c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:10.800788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:10.801392 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:10.801678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:10.801951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.802604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:50:10.802899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:10.804491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:10.817397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1352/2664] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:50:10.821751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d1124-27c4-431e-88f0-4e894dde5c31 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:10.831069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d1124-27c4-431e-88f0-4e894dde5c31 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:10.835900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ebc4-0a4d-4beb-a392-23d8dea11e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:10.836501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ebc4-0a4d-4beb-a392-23d8dea11e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:10.836780 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ebc4-0a4d-4beb-a392-23d8dea11e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:10.837049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ebc4-0a4d-4beb-a392-23d8dea11e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.837688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52ebc4-0a4d-4beb-a392-23d8dea11e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:10.839637 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52ebc4-0a4d-4beb-a392-23d8dea11e3f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:10.868857 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1313/2665] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:10 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:10.873061 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:10.879975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:10.884063 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4d03d-4dc7-41cc-acee-a5738802510c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:10.953540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb65f4-05de-417c-959f-943dd0099df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:10.954246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb65f4-05de-417c-959f-943dd0099df9 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:10.954450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb65f4-05de-417c-959f-943dd0099df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:10.954969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb65f4-05de-417c-959f-943dd0099df9 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:10.955599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb65f4-05de-417c-959f-943dd0099df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:10.957731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb65f4-05de-417c-959f-943dd0099df9 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:10.989861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1353/2666] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:10 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:10.992011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ebc4-0a4d-4beb-a392-23d8dea11e3f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:11.005160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ebc4-0a4d-4beb-a392-23d8dea11e3f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:11.017859 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc4fe8-1e62-4324-946e-3ac90457f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:11.018762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc4fe8-1e62-4324-946e-3ac90457f46d admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:11.019048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc4fe8-1e62-4324-946e-3ac90457f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:11.019337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc4fe8-1e62-4324-946e-3ac90457f46d admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:11.019974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc4fe8-1e62-4324-946e-3ac90457f46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:11.021715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc4fe8-1e62-4324-946e-3ac90457f46d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:11.033720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1314/2667] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:50:11.038031 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb65f4-05de-417c-959f-943dd0099df9 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:11.051207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb65f4-05de-417c-959f-943dd0099df9 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:11.057311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23694f21-f83c-46b2-939c-46eb98fc98c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:11.057964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23694f21-f83c-46b2-939c-46eb98fc98c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:11.058242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23694f21-f83c-46b2-939c-46eb98fc98c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:11.058554 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23694f21-f83c-46b2-939c-46eb98fc98c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:11.059217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23694f21-f83c-46b2-939c-46eb98fc98c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:11.060861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23694f21-f83c-46b2-939c-46eb98fc98c0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:11.074003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1354/2668] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:11.079144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc4fe8-1e62-4324-946e-3ac90457f46d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:11.089319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc4fe8-1e62-4324-946e-3ac90457f46d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:11.095160 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:11.095854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:11.096133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:11.096405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] PATH_INFO: `/v3/projects/d321c2e51717485f92adc797d75a811b/users/57e8a1359fae4d229358fbc9641460e0/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:11.118442 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d321c2e51717485f92adc797d75a811b, user_id=57e8a1359fae4d229358fbc9641460e0, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:11.121367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:11.136621 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1315/2669] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:11 2022] PUT /identity/v3/projects/d321c2e51717485f92adc797d75a811b/users/57e8a1359fae4d229358fbc9641460e0/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:11.147989 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383925e7-3d9c-4153-80db-aa6851e6c9b6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:11.148273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383925e7-3d9c-4153-80db-aa6851e6c9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:11.148550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383925e7-3d9c-4153-80db-aa6851e6c9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:11.181195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-383925e7-3d9c-4153-80db-aa6851e6c9b6 None None] MFA Rules not processed for user `57e8a1359fae4d229358fbc9641460e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:11.182297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-383925e7-3d9c-4153-80db-aa6851e6c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:11.257539 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1355/2670] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:11.269226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:11.271030 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:11.305246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:11.337174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8aafd-e967-4c46-8e2d-7f52d879ee82 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:11.341055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8dbb1-9422-4716-9239-199d27931520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:11.341716 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8dbb1-9422-4716-9239-199d27931520 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:11.342029 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8dbb1-9422-4716-9239-199d27931520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:11.342409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8dbb1-9422-4716-9239-199d27931520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:11.351639 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8dbb1-9422-4716-9239-199d27931520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:11.353155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8dbb1-9422-4716-9239-199d27931520 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:11.366161 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1316/2671] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:12.489653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383925e7-3d9c-4153-80db-aa6851e6c9b6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:12.491243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-383925e7-3d9c-4153-80db-aa6851e6c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:12.578277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383925e7-3d9c-4153-80db-aa6851e6c9b6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:12.583270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:12.583996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:12.584318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:12.584635 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] PATH_INFO: `/v3/users/f13827cbc5bb4ad0ad98f7295dd3a9a3` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:12.585908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13827cbc5bb4ad0ad98f7295dd3a9a3)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:12.587907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:12.604455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:12.655757 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13827cbc5bb4ad0ad98f7295dd3a9a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:12.668620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13827cbc5bb4ad0ad98f7295dd3a9a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:12.669407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13827cbc5bb4ad0ad98f7295dd3a9a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:12.670056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13827cbc5bb4ad0ad98f7295dd3a9a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:12.679862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13827cbc5bb4ad0ad98f7295dd3a9a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:12.700242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1356/2672] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:12 2022] DELETE /identity/v3/users/f13827cbc5bb4ad0ad98f7295dd3a9a3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:12.705426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b7515-d0db-4e4c-85b3-f5d3d515894b None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:12.706189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b7515-d0db-4e4c-85b3-f5d3d515894b None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:12.706189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b7515-d0db-4e4c-85b3-f5d3d515894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:12.728038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-585b7515-d0db-4e4c-85b3-f5d3d515894b None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:12.729281 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-585b7515-d0db-4e4c-85b3-f5d3d515894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:12.808720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1317/2673] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:12.820170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:12.822071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:12.893317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03bdc6-1673-4315-8600-45a5f5cff03b admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:12.897455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04517055-da24-42f7-b7dd-583d7f3ccb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:12.898255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04517055-da24-42f7-b7dd-583d7f3ccb7a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:12.898571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04517055-da24-42f7-b7dd-583d7f3ccb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:12.898850 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04517055-da24-42f7-b7dd-583d7f3ccb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:12.910169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04517055-da24-42f7-b7dd-583d7f3ccb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:12.911663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04517055-da24-42f7-b7dd-583d7f3ccb7a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:12.923945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1357/2674] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:13.278073 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b7515-d0db-4e4c-85b3-f5d3d515894b None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:13.279628 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-585b7515-d0db-4e4c-85b3-f5d3d515894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:13.292942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b7515-d0db-4e4c-85b3-f5d3d515894b None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:13.299508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:13.300212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:13.300471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:13.300737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] PATH_INFO: `/v3/projects/b23233950f864f7c99458b449ceb19a9` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:13.301990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23233950f864f7c99458b449ceb19a9)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:13.303986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:13.373569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23233950f864f7c99458b449ceb19a9', 'request_id': 'req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.381262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23233950f864f7c99458b449ceb19a9', 'request_id': 'req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.391838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23233950f864f7c99458b449ceb19a9', 'request_id': 'req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.403799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] The token cache is being invalidate because project b23233950f864f7c99458b449ceb19a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:13.404096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.404915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.407099 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1318/2675] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:13 2022] DELETE /identity/v3/projects/b23233950f864f7c99458b449ceb19a9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:13.411436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04517055-da24-42f7-b7dd-583d7f3ccb7a service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:13.424398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04517055-da24-42f7-b7dd-583d7f3ccb7a service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:13.490629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:13.491370 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:13.491534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:13.491795 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] PATH_INFO: `/v3/users/619afc91ef58445080becf641db5e722` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:13.492951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619afc91ef58445080becf641db5e722)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:13.494927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:13.539745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:13.550743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619afc91ef58445080becf641db5e722'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.563118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619afc91ef58445080becf641db5e722'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.563823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619afc91ef58445080becf641db5e722'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.564424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619afc91ef58445080becf641db5e722'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.577263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-27a7d8a4-2f54-4926-a71d-0789da2fe1e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619afc91ef58445080becf641db5e722'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:13.591226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1358/2676] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:13 2022] DELETE /identity/v3/users/619afc91ef58445080becf641db5e722 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:13.900898 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:13.902536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:13.920498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ac0fc-475f-4a8d-ad43-cf067a84d4cd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:13.975614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:13.989222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:13.989872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:13.990148 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:13.990523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] PATH_INFO: `/v3/projects/7f758c78b79b45a691df6b4f99161d16` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:13.991704 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f758c78b79b45a691df6b4f99161d16)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:13.993672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.051432 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f758c78b79b45a691df6b4f99161d16', 'request_id': 'req-592fac2b-f8ec-4900-adbf-7d00986b3787'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:14.061846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f758c78b79b45a691df6b4f99161d16', 'request_id': 'req-592fac2b-f8ec-4900-adbf-7d00986b3787'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:14.072463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f758c78b79b45a691df6b4f99161d16', 'request_id': 'req-592fac2b-f8ec-4900-adbf-7d00986b3787'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:14.084724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] The token cache is being invalidate because project 7f758c78b79b45a691df6b4f99161d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:14.085014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:14.085638 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-592fac2b-f8ec-4900-adbf-7d00986b3787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:14.087229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1319/2677] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:13 2022] DELETE /identity/v3/projects/7f758c78b79b45a691df6b4f99161d16 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:14.096402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f310-e48c-4ea9-95a1-11fdc2dd2e2c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.096763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f310-e48c-4ea9-95a1-11fdc2dd2e2c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.097107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f310-e48c-4ea9-95a1-11fdc2dd2e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.119416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-8376f310-e48c-4ea9-95a1-11fdc2dd2e2c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:14.120717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8376f310-e48c-4ea9-95a1-11fdc2dd2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:14.208522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1359/2678] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:14.220126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242780-ec28-460a-93cd-67f2b80fbc2c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.220380 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242780-ec28-460a-93cd-67f2b80fbc2c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.220790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242780-ec28-460a-93cd-67f2b80fbc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.243368 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-92242780-ec28-460a-93cd-67f2b80fbc2c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:14.244724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-92242780-ec28-460a-93cd-67f2b80fbc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:14.253274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1320/2679] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:14.257873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f310-e48c-4ea9-95a1-11fdc2dd2e2c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.268492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f310-e48c-4ea9-95a1-11fdc2dd2e2c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:14.273356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:14.273970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.274244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.274559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.275198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:50:14.275497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:14.277103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.290059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1360/2680] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:50:14.296379 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242780-ec28-460a-93cd-67f2b80fbc2c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.307739 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242780-ec28-460a-93cd-67f2b80fbc2c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:14.315051 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae61e-0233-4521-8822-137d0c09e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:14.315727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae61e-0233-4521-8822-137d0c09e5af admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.316015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae61e-0233-4521-8822-137d0c09e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.316282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae61e-0233-4521-8822-137d0c09e5af admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.316950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae61e-0233-4521-8822-137d0c09e5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:14.319039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae61e-0233-4521-8822-137d0c09e5af admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.355121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1321/2681] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:14 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:14.360969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.372132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a5063-2051-4de3-bf15-bff6a6aa9703 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:14.441646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd871f24-1378-4169-ba57-555cedbf47c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:14.442875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871f24-1378-4169-ba57-555cedbf47c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.443148 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871f24-1378-4169-ba57-555cedbf47c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.443421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd871f24-1378-4169-ba57-555cedbf47c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.444127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd871f24-1378-4169-ba57-555cedbf47c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:14.446177 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd871f24-1378-4169-ba57-555cedbf47c1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.470216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1361/2682] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:14 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:14.475744 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae61e-0233-4521-8822-137d0c09e5af admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.488684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae61e-0233-4521-8822-137d0c09e5af admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:14.493743 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e08a-951f-4db8-8463-1a2885c80b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:14.494371 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e08a-951f-4db8-8463-1a2885c80b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.494681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e08a-951f-4db8-8463-1a2885c80b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.494964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e08a-951f-4db8-8463-1a2885c80b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.495596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664e08a-951f-4db8-8463-1a2885c80b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:14.497246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664e08a-951f-4db8-8463-1a2885c80b20 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.512667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1322/2683] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:14.514663 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd871f24-1378-4169-ba57-555cedbf47c1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.525043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd871f24-1378-4169-ba57-555cedbf47c1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:14.531727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24bd3d-cb41-4d79-8e0a-500c4aca7be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:14.532475 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24bd3d-cb41-4d79-8e0a-500c4aca7be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.532610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24bd3d-cb41-4d79-8e0a-500c4aca7be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.532896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24bd3d-cb41-4d79-8e0a-500c4aca7be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.533543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24bd3d-cb41-4d79-8e0a-500c4aca7be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:14.535232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24bd3d-cb41-4d79-8e0a-500c4aca7be8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.548833 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1362/2684] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:14.554001 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e08a-951f-4db8-8463-1a2885c80b20 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.565719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e08a-951f-4db8-8463-1a2885c80b20 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:14.572071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7eb2-596c-4543-82eb-49386690ad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:14.572797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7eb2-596c-4543-82eb-49386690ad79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.573269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7eb2-596c-4543-82eb-49386690ad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.573766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7eb2-596c-4543-82eb-49386690ad79 admin admin] PATH_INFO: `/v3/projects/56e4b46ee3484be79a9fae22fb957990/users/8113cfcf67b34952a6fa9df3a3f8f5a8/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.591357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a7eb2-596c-4543-82eb-49386690ad79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e4b46ee3484be79a9fae22fb957990, user_id=8113cfcf67b34952a6fa9df3a3f8f5a8, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:14.594675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a7eb2-596c-4543-82eb-49386690ad79 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.609355 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1323/2685] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:14 2022] PUT /identity/v3/projects/56e4b46ee3484be79a9fae22fb957990/users/8113cfcf67b34952a6fa9df3a3f8f5a8/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:14.621234 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf838d-1d1c-4d5b-89f8-8d30e9a50ba6 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.621466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf838d-1d1c-4d5b-89f8-8d30e9a50ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.621775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf838d-1d1c-4d5b-89f8-8d30e9a50ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.652810 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-24cf838d-1d1c-4d5b-89f8-8d30e9a50ba6 None None] MFA Rules not processed for user `8113cfcf67b34952a6fa9df3a3f8f5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:14.654059 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-24cf838d-1d1c-4d5b-89f8-8d30e9a50ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:14.663832 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:14.729915 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1363/2686] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:14.734792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7eb2-596c-4543-82eb-49386690ad79 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.800054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7eb2-596c-4543-82eb-49386690ad79 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:14.805260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe60a-863c-41ab-b17f-eac06aafa93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:14.805878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe60a-863c-41ab-b17f-eac06aafa93c admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.806170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe60a-863c-41ab-b17f-eac06aafa93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.806466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe60a-863c-41ab-b17f-eac06aafa93c admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.807100 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe60a-863c-41ab-b17f-eac06aafa93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:14.809033 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe60a-863c-41ab-b17f-eac06aafa93c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.838953 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1324/2687] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:14 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:14.844187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf838d-1d1c-4d5b-89f8-8d30e9a50ba6 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.856454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf838d-1d1c-4d5b-89f8-8d30e9a50ba6 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:14.932494 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c3b09-2d99-4450-90e1-f0076e9223d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:14.933545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3b09-2d99-4450-90e1-f0076e9223d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:14.934040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3b09-2d99-4450-90e1-f0076e9223d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:14.934576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3b09-2d99-4450-90e1-f0076e9223d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:14.935740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c3b09-2d99-4450-90e1-f0076e9223d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:14.939526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c3b09-2d99-4450-90e1-f0076e9223d1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:14.977650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1364/2688] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:14 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:14.981924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe60a-863c-41ab-b17f-eac06aafa93c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:14.987997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:14.998660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe60a-863c-41ab-b17f-eac06aafa93c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:15.005602 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103af955-77bb-4f09-9161-fde76f35131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:15.006260 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103af955-77bb-4f09-9161-fde76f35131a admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:15.006559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103af955-77bb-4f09-9161-fde76f35131a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:15.006813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103af955-77bb-4f09-9161-fde76f35131a admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:15.007462 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103af955-77bb-4f09-9161-fde76f35131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:15.009110 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103af955-77bb-4f09-9161-fde76f35131a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:15.021688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1325/2689] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:15.026038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c3b09-2d99-4450-90e1-f0076e9223d1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:15.036743 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c3b09-2d99-4450-90e1-f0076e9223d1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:15.041937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381cb0f-72ec-409d-84f0-9bb7a43f7427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:15.042655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381cb0f-72ec-409d-84f0-9bb7a43f7427 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:15.042928 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381cb0f-72ec-409d-84f0-9bb7a43f7427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:15.043196 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381cb0f-72ec-409d-84f0-9bb7a43f7427 admin admin] PATH_INFO: `/v3/projects/8152d096ced7474bbd442e8d9e5da0a4/users/869700c29fca465a8ac2ed56e736bf1c/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:15.062559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381cb0f-72ec-409d-84f0-9bb7a43f7427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8152d096ced7474bbd442e8d9e5da0a4, user_id=869700c29fca465a8ac2ed56e736bf1c, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:15.065709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381cb0f-72ec-409d-84f0-9bb7a43f7427 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:15.083071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1365/2690] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:15 2022] PUT /identity/v3/projects/8152d096ced7474bbd442e8d9e5da0a4/users/869700c29fca465a8ac2ed56e736bf1c/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:15.087531 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103af955-77bb-4f09-9161-fde76f35131a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:15.098971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103af955-77bb-4f09-9161-fde76f35131a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:15.167057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56f196-39f7-4eea-a91f-e7d536335541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:15.167706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56f196-39f7-4eea-a91f-e7d536335541 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:15.167997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56f196-39f7-4eea-a91f-e7d536335541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:15.168261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56f196-39f7-4eea-a91f-e7d536335541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:15.168917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56f196-39f7-4eea-a91f-e7d536335541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:15.171279 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56f196-39f7-4eea-a91f-e7d536335541 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:15.184668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1326/2691] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:15.189904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381cb0f-72ec-409d-84f0-9bb7a43f7427 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:15.203205 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381cb0f-72ec-409d-84f0-9bb7a43f7427 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:15.208815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:15.209788 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:15.210071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:15.210407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] PATH_INFO: `/v3/projects/8152d096ced7474bbd442e8d9e5da0a4/users/869700c29fca465a8ac2ed56e736bf1c/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:15.212769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8152d096ced7474bbd442e8d9e5da0a4, user_id=869700c29fca465a8ac2ed56e736bf1c, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:15.215499 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:15.228952 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1366/2692] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:15 2022] PUT /identity/v3/projects/8152d096ced7474bbd442e8d9e5da0a4/users/869700c29fca465a8ac2ed56e736bf1c/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:50:15.241834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78cb7-ee58-4e1f-965e-29ca66f8bcb0 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:15.242084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78cb7-ee58-4e1f-965e-29ca66f8bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:15.242554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa78cb7-ee58-4e1f-965e-29ca66f8bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:15.289301 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-7fa78cb7-ee58-4e1f-965e-29ca66f8bcb0 None None] MFA Rules not processed for user `869700c29fca465a8ac2ed56e736bf1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:15.290642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-7fa78cb7-ee58-4e1f-965e-29ca66f8bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:15.386012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1327/2693] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:15.398871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:15.400727 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:15.472621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e13c9-5b53-4272-b693-bda78db24389 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:15.477369 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6b294-538a-44aa-b931-dbbbb54f6c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:15.478251 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b294-538a-44aa-b931-dbbbb54f6c64 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:15.478741 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b294-538a-44aa-b931-dbbbb54f6c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:15.479035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b294-538a-44aa-b931-dbbbb54f6c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:15.488852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6b294-538a-44aa-b931-dbbbb54f6c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:15.490297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6b294-538a-44aa-b931-dbbbb54f6c64 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:15.502933 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1367/2694] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:15.617324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78cb7-ee58-4e1f-965e-29ca66f8bcb0 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:15.627481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa78cb7-ee58-4e1f-965e-29ca66f8bcb0 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:15.631295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d98ab-c3fb-42a3-a220-53e8a6a52e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:15.631912 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d98ab-c3fb-42a3-a220-53e8a6a52e43 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:15.632184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d98ab-c3fb-42a3-a220-53e8a6a52e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:15.632450 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d98ab-c3fb-42a3-a220-53e8a6a52e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:15.705686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d98ab-c3fb-42a3-a220-53e8a6a52e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:15.707380 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d98ab-c3fb-42a3-a220-53e8a6a52e43 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:15.717664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1328/2695] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:18.415880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6b294-538a-44aa-b931-dbbbb54f6c64 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:18.424264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:18.490356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6b294-538a-44aa-b931-dbbbb54f6c64 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:18.495619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:18.496314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:18.496600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:18.496908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] PATH_INFO: `/v3/users/8113cfcf67b34952a6fa9df3a3f8f5a8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:18.498127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8113cfcf67b34952a6fa9df3a3f8f5a8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:18.501278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:18.559764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8113cfcf67b34952a6fa9df3a3f8f5a8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:18.581397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8113cfcf67b34952a6fa9df3a3f8f5a8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:18.582706 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8113cfcf67b34952a6fa9df3a3f8f5a8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:18.583811 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8113cfcf67b34952a6fa9df3a3f8f5a8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:18.596068 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8113cfcf67b34952a6fa9df3a3f8f5a8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:18.612296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1368/2696] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:18 2022] DELETE /identity/v3/users/8113cfcf67b34952a6fa9df3a3f8f5a8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:18.616963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e84b-e3df-4dbc-9191-8e809258a945 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:18.617479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e84b-e3df-4dbc-9191-8e809258a945 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:18.617578 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e84b-e3df-4dbc-9191-8e809258a945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:18.637158 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-3a43e84b-e3df-4dbc-9191-8e809258a945 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:18.638365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3a43e84b-e3df-4dbc-9191-8e809258a945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:18.644423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=100 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:18.710957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1329/2697] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:18.721207 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:18.723423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:18.798990 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7471e2a-ac23-4cd9-8f92-1618ac94b883 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:18.803367 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffa3b2-08a9-4038-9447-b75808b1ffcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:18.803994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffa3b2-08a9-4038-9447-b75808b1ffcb service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:18.804277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffa3b2-08a9-4038-9447-b75808b1ffcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:18.804565 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffa3b2-08a9-4038-9447-b75808b1ffcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:18.814150 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffa3b2-08a9-4038-9447-b75808b1ffcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:18.815600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffa3b2-08a9-4038-9447-b75808b1ffcb service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:18.825406 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1369/2698] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:19.127504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e84b-e3df-4dbc-9191-8e809258a945 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:19.129430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-3a43e84b-e3df-4dbc-9191-8e809258a945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:19.145878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e84b-e3df-4dbc-9191-8e809258a945 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:19.151817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:19.152472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:19.152751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:19.153021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] PATH_INFO: `/v3/projects/56e4b46ee3484be79a9fae22fb957990` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:19.155183 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e4b46ee3484be79a9fae22fb957990)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:19.157532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:19.211293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e4b46ee3484be79a9fae22fb957990', 'request_id': 'req-2125c85b-a1ac-490c-b032-55c88a59f21a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.219164 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e4b46ee3484be79a9fae22fb957990', 'request_id': 'req-2125c85b-a1ac-490c-b032-55c88a59f21a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.229222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e4b46ee3484be79a9fae22fb957990', 'request_id': 'req-2125c85b-a1ac-490c-b032-55c88a59f21a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.246736 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] The token cache is being invalidate because project 56e4b46ee3484be79a9fae22fb957990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:19.247031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.248720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.250004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1330/2699] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:19 2022] DELETE /identity/v3/projects/56e4b46ee3484be79a9fae22fb957990 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:19.254642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffa3b2-08a9-4038-9447-b75808b1ffcb service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:19.265416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffa3b2-08a9-4038-9447-b75808b1ffcb service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:19.298201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:19.336704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:19.337350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:19.337626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:19.337929 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] PATH_INFO: `/v3/users/869700c29fca465a8ac2ed56e736bf1c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:19.339080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] RBAC: Authorizing `identity:delete_user(user_id=869700c29fca465a8ac2ed56e736bf1c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:19.341062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:19.403685 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869700c29fca465a8ac2ed56e736bf1c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.421628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869700c29fca465a8ac2ed56e736bf1c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.422984 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869700c29fca465a8ac2ed56e736bf1c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.424022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869700c29fca465a8ac2ed56e736bf1c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.432777 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86291bc-5c9a-4c70-b339-c2812cbe822a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869700c29fca465a8ac2ed56e736bf1c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.450764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1370/2700] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:19 2022] DELETE /identity/v3/users/869700c29fca465a8ac2ed56e736bf1c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:50:19.775783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:19.777691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:19.793284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125c85b-a1ac-490c-b032-55c88a59f21a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:19.859894 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:19.860540 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:19.860817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:19.861090 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] PATH_INFO: `/v3/projects/8152d096ced7474bbd442e8d9e5da0a4` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:19.862268 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8152d096ced7474bbd442e8d9e5da0a4)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:19.864241 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:19.907361 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:19.920147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8152d096ced7474bbd442e8d9e5da0a4', 'request_id': 'req-8a52f626-6b4a-4624-8b0a-da8f7df601dd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.932536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8152d096ced7474bbd442e8d9e5da0a4', 'request_id': 'req-8a52f626-6b4a-4624-8b0a-da8f7df601dd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.942862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8152d096ced7474bbd442e8d9e5da0a4', 'request_id': 'req-8a52f626-6b4a-4624-8b0a-da8f7df601dd'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.957059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] The token cache is being invalidate because project 8152d096ced7474bbd442e8d9e5da0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:19.957305 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.958093 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-8a52f626-6b4a-4624-8b0a-da8f7df601dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:19.959861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1331/2701] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:19 2022] DELETE /identity/v3/projects/8152d096ced7474bbd442e8d9e5da0a4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:19.965131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15302-71b7-4897-8f2e-074d0fc706fa None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:19.965586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15302-71b7-4897-8f2e-074d0fc706fa None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:19.965938 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15302-71b7-4897-8f2e-074d0fc706fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:19.986395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-33d15302-71b7-4897-8f2e-074d0fc706fa None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:19.987658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-33d15302-71b7-4897-8f2e-074d0fc706fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:20.059964 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1371/2702] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:20.068470 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f317-f39d-410b-986b-3b1dcd35fcea None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.068755 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f317-f39d-410b-986b-3b1dcd35fcea None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.069025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6f317-f39d-410b-986b-3b1dcd35fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.090420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-43f6f317-f39d-410b-986b-3b1dcd35fcea None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:20.091664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-43f6f317-f39d-410b-986b-3b1dcd35fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:20.101331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1332/2703] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:20.106191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d15302-71b7-4897-8f2e-074d0fc706fa None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.117081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d15302-71b7-4897-8f2e-074d0fc706fa None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.122151 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.122814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.123092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.123415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.124075 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:50:20.124375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.126006 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.140862 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1372/2704] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:50:20.145668 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6f317-f39d-410b-986b-3b1dcd35fcea None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.162409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6f317-f39d-410b-986b-3b1dcd35fcea None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.170343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9ba3-e172-4432-8583-9403db616d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.171472 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9ba3-e172-4432-8583-9403db616d9f admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.172324 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9ba3-e172-4432-8583-9403db616d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.172798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9ba3-e172-4432-8583-9403db616d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.173596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f9ba3-e172-4432-8583-9403db616d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.177381 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f9ba3-e172-4432-8583-9403db616d9f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.218731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1333/2705] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:20 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:20.223931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.235526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018601-2956-4003-9e85-074d1800c636 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.269438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:20.303657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a44d-29ab-4d39-b1ff-430cf2520b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.304344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a44d-29ab-4d39-b1ff-430cf2520b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.304603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a44d-29ab-4d39-b1ff-430cf2520b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.304893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a44d-29ab-4d39-b1ff-430cf2520b61 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.305543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7a44d-29ab-4d39-b1ff-430cf2520b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.307505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7a44d-29ab-4d39-b1ff-430cf2520b61 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.330216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1373/2706] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:20 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:50:20.334797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9ba3-e172-4432-8583-9403db616d9f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.346267 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9ba3-e172-4432-8583-9403db616d9f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.352408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19758-ab1a-40ee-9965-6ff48ac15326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.353140 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19758-ab1a-40ee-9965-6ff48ac15326 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.353319 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19758-ab1a-40ee-9965-6ff48ac15326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.353561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19758-ab1a-40ee-9965-6ff48ac15326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.354205 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b19758-ab1a-40ee-9965-6ff48ac15326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.355889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b19758-ab1a-40ee-9965-6ff48ac15326 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.367644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1334/2707] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:20.371916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a44d-29ab-4d39-b1ff-430cf2520b61 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.385099 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a44d-29ab-4d39-b1ff-430cf2520b61 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.392098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2eab8-e26e-4c0e-99d7-c60977f2af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.393038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2eab8-e26e-4c0e-99d7-c60977f2af9d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.393345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2eab8-e26e-4c0e-99d7-c60977f2af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.393637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2eab8-e26e-4c0e-99d7-c60977f2af9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.394501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2eab8-e26e-4c0e-99d7-c60977f2af9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.396648 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2eab8-e26e-4c0e-99d7-c60977f2af9d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.408461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1374/2708] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:20.418032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19758-ab1a-40ee-9965-6ff48ac15326 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.429481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19758-ab1a-40ee-9965-6ff48ac15326 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.443396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.443719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.444262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.444535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] PATH_INFO: `/v3/projects/e6a510ce2f29445d97f62ceb8a1b2a34/users/5ca12004644440b599fa30653c0117d7/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.461367 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a510ce2f29445d97f62ceb8a1b2a34, user_id=5ca12004644440b599fa30653c0117d7, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.464055 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.480735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1335/2709] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:20 2022] PUT /identity/v3/projects/e6a510ce2f29445d97f62ceb8a1b2a34/users/5ca12004644440b599fa30653c0117d7/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:20.492824 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d818-bce5-49a4-8c01-7c54dc32076a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.493323 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d818-bce5-49a4-8c01-7c54dc32076a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.493434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d818-bce5-49a4-8c01-7c54dc32076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.539520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-d1c7d818-bce5-49a4-8c01-7c54dc32076a None None] MFA Rules not processed for user `5ca12004644440b599fa30653c0117d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:20.540908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d1c7d818-bce5-49a4-8c01-7c54dc32076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:20.621721 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.623969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:20.626480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1375/2710] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:20.638746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d818-bce5-49a4-8c01-7c54dc32076a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.641118 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d1c7d818-bce5-49a4-8c01-7c54dc32076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:20.710521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf2bf-036c-4a41-854e-836d7653a173 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.710809 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d818-bce5-49a4-8c01-7c54dc32076a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.715055 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908c973-c75e-4e57-a729-729da2c8c47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.715256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc0343-0024-4ff2-81bf-45e561ff5327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.715597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0343-0024-4ff2-81bf-45e561ff5327 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.716173 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908c973-c75e-4e57-a729-729da2c8c47a service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.716300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0343-0024-4ff2-81bf-45e561ff5327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.716400 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908c973-c75e-4e57-a729-729da2c8c47a service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.716493 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0343-0024-4ff2-81bf-45e561ff5327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.716700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908c973-c75e-4e57-a729-729da2c8c47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.719061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-47dc0343-0024-4ff2-81bf-45e561ff5327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:20.728048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908c973-c75e-4e57-a729-729da2c8c47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.729730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908c973-c75e-4e57-a729-729da2c8c47a service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.734731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc0343-0024-4ff2-81bf-45e561ff5327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.736171 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc0343-0024-4ff2-81bf-45e561ff5327 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.740431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1376/2711] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:20.745306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1336/2712] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:20.760921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908c973-c75e-4e57-a729-729da2c8c47a service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.813616 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:20.836714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908c973-c75e-4e57-a729-729da2c8c47a service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:20.841470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:20.843044 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.843398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.843676 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] PATH_INFO: `/v3/users/5ca12004644440b599fa30653c0117d7` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.845093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca12004644440b599fa30653c0117d7)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:20.850453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:20.907083 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3c0c8-0635-42cf-8ef6-324dbb3c1daa None None] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.907991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3c0c8-0635-42cf-8ef6-324dbb3c1daa None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.908270 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3c0c8-0635-42cf-8ef6-324dbb3c1daa None None] PATH_INFO: `/` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.909713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1337/2713] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:50:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 14:50:20.918921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466c4d-a847-4b74-ac32-07ec6c68a7b7 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.919618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466c4d-a847-4b74-ac32-07ec6c68a7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.919892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466c4d-a847-4b74-ac32-07ec6c68a7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.920807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca12004644440b599fa30653c0117d7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:20.939081 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca12004644440b599fa30653c0117d7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:20.940176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca12004644440b599fa30653c0117d7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:20.940961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca12004644440b599fa30653c0117d7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:20.942418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-11466c4d-a847-4b74-ac32-07ec6c68a7b7 None None] MFA Rules not processed for user `6b24f12951bd4220afad25f23f566f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:20.943684 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-11466c4d-a847-4b74-ac32-07ec6c68a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:20.951854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-02159e5c-5016-418e-a564-446ede566f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca12004644440b599fa30653c0117d7'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:20.953660 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1338/2714] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:20.967832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466c4d-a847-4b74-ac32-07ec6c68a7b7 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:20.969605 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-11466c4d-a847-4b74-ac32-07ec6c68a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:20.972697 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1377/2715] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:20 2022] DELETE /identity/v3/users/5ca12004644440b599fa30653c0117d7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:20.977152 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aec2d-60da-4a86-ba0c-2db7ac971599 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:20.977439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aec2d-60da-4a86-ba0c-2db7ac971599 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:20.977714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aec2d-60da-4a86-ba0c-2db7ac971599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:20.984088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466c4d-a847-4b74-ac32-07ec6c68a7b7 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:21.001742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c06aec2d-60da-4a86-ba0c-2db7ac971599 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:21.002901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c06aec2d-60da-4a86-ba0c-2db7ac971599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.045799 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3d260-bba7-4af4-aebf-0ac15808f7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:21.046677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3d260-bba7-4af4-aebf-0ac15808f7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.047313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3d260-bba7-4af4-aebf-0ac15808f7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.047648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3d260-bba7-4af4-aebf-0ac15808f7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.055787 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3d260-bba7-4af4-aebf-0ac15808f7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:21.057249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3d260-bba7-4af4-aebf-0ac15808f7d4 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:21.062199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:21.066508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1339/2716] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:21.075106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1378/2717] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:21.100992 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3d260-bba7-4af4-aebf-0ac15808f7d4 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:21.111069 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3d260-bba7-4af4-aebf-0ac15808f7d4 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:21.115349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271836b9-170f-4264-952b-5e0d3e5d7956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:21.115970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271836b9-170f-4264-952b-5e0d3e5d7956 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.116250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271836b9-170f-4264-952b-5e0d3e5d7956 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.116516 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271836b9-170f-4264-952b-5e0d3e5d7956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.127890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271836b9-170f-4264-952b-5e0d3e5d7956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:21.129342 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271836b9-170f-4264-952b-5e0d3e5d7956 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:21.140607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1340/2718] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:21.157289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd28eea-14f8-4eff-be6f-44eb00c33a21 None None] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.157567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd28eea-14f8-4eff-be6f-44eb00c33a21 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.157834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd28eea-14f8-4eff-be6f-44eb00c33a21 None None] PATH_INFO: `/` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.159383 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1379/2719] 10.222.0.49 () {54 vars in 921 bytes} [Tue Aug 30 14:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 14:50:21.165210 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66364293-7844-484f-89fe-4a6bb43386a5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.165488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66364293-7844-484f-89fe-4a6bb43386a5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.165759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66364293-7844-484f-89fe-4a6bb43386a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.188580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-66364293-7844-484f-89fe-4a6bb43386a5 None None] MFA Rules not processed for user `906464ed50294dc481c4d1d570a5195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:21.189960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-66364293-7844-484f-89fe-4a6bb43386a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.264618 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1341/2720] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Aug 30 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:21.275388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd28eea-14f8-4eff-be6f-44eb00c33a21 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:21.277227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-abd28eea-14f8-4eff-be6f-44eb00c33a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.293270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd28eea-14f8-4eff-be6f-44eb00c33a21 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:21.300611 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088543-893e-4e60-b2e4-ed02dc47d2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:21.301210 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088543-893e-4e60-b2e4-ed02dc47d2ce service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.301483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088543-893e-4e60-b2e4-ed02dc47d2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.302098 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088543-893e-4e60-b2e4-ed02dc47d2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.314769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56088543-893e-4e60-b2e4-ed02dc47d2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:21.316216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56088543-893e-4e60-b2e4-ed02dc47d2ce service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:21.328760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1380/2721] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:21.512215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66364293-7844-484f-89fe-4a6bb43386a5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:21.513841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-66364293-7844-484f-89fe-4a6bb43386a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.533852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66364293-7844-484f-89fe-4a6bb43386a5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:21.539887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:21.540467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.540763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.541156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] PATH_INFO: `/v3/projects/e6a510ce2f29445d97f62ceb8a1b2a34` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.543889 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a510ce2f29445d97f62ceb8a1b2a34)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:21.547676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:21.611306 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a510ce2f29445d97f62ceb8a1b2a34', 'request_id': 'req-abcee206-5078-4064-a353-0dc58a59621a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.622670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a510ce2f29445d97f62ceb8a1b2a34', 'request_id': 'req-abcee206-5078-4064-a353-0dc58a59621a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.638286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a510ce2f29445d97f62ceb8a1b2a34', 'request_id': 'req-abcee206-5078-4064-a353-0dc58a59621a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.653990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] The token cache is being invalidate because project e6a510ce2f29445d97f62ceb8a1b2a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:21.654288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.655032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.656871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1342/2722] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:21 2022] DELETE /identity/v3/projects/e6a510ce2f29445d97f62ceb8a1b2a34 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:21.661584 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7328a0-5ab0-4e6f-9edb-ac1d65e6d09f None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.662110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7328a0-5ab0-4e6f-9edb-ac1d65e6d09f None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.662297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7328a0-5ab0-4e6f-9edb-ac1d65e6d09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.684671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-ad7328a0-5ab0-4e6f-9edb-ac1d65e6d09f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:21.685934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-ad7328a0-5ab0-4e6f-9edb-ac1d65e6d09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.687682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:21.689096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.761555 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcee206-5078-4064-a353-0dc58a59621a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:21.764332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:21.768089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:21.769101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.769596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.769974 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] PATH_INFO: `/v3/users/57e8a1359fae4d229358fbc9641460e0` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.771313 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e8a1359fae4d229358fbc9641460e0)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:21.773391 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:21.776334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:21.793110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1381/2723] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:21.801621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4f03-53ca-46b9-bb79-d746ccdd4891 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.801910 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4f03-53ca-46b9-bb79-d746ccdd4891 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.802187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4f03-53ca-46b9-bb79-d746ccdd4891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.824951 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-545f4f03-53ca-46b9-bb79-d746ccdd4891 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:21.826680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-545f4f03-53ca-46b9-bb79-d746ccdd4891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.836153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1382/2724] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:21.840712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4f03-53ca-46b9-bb79-d746ccdd4891 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:21.849032 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e8a1359fae4d229358fbc9641460e0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.852388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4f03-53ca-46b9-bb79-d746ccdd4891 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:21.858134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:21.858986 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.859335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.859673 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.860449 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:50:21.860972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:21.862955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:21.868990 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e8a1359fae4d229358fbc9641460e0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.877487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e8a1359fae4d229358fbc9641460e0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.878488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e8a1359fae4d229358fbc9641460e0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.879285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-84c6cd55-f5a3-499f-9240-31339ebdd16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e8a1359fae4d229358fbc9641460e0'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:21.882437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1383/2725] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:50:21.884879 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:21.887522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.897488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1343/2726] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:21 2022] DELETE /identity/v3/users/57e8a1359fae4d229358fbc9641460e0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:50:21.902048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b01db-f05e-47c8-8512-d0a1b2a21502 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.902337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b01db-f05e-47c8-8512-d0a1b2a21502 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.902651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b01db-f05e-47c8-8512-d0a1b2a21502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.905483 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907b345-b436-41ca-b474-19bd8ce23b59 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:21.926128 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-854b01db-f05e-47c8-8512-d0a1b2a21502 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:21.927441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-854b01db-f05e-47c8-8512-d0a1b2a21502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:21.970149 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc939-2a16-466a-aa99-dad557af10c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:21.971110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc939-2a16-466a-aa99-dad557af10c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:21.971393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc939-2a16-466a-aa99-dad557af10c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:21.971667 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc939-2a16-466a-aa99-dad557af10c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:21.972604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fc939-2a16-466a-aa99-dad557af10c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:21.974424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fc939-2a16-466a-aa99-dad557af10c5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:21.996250 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1344/2727] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:22.004423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b01db-f05e-47c8-8512-d0a1b2a21502 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:22.006481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-854b01db-f05e-47c8-8512-d0a1b2a21502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:22.007875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1384/2728] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:21 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:50:22.012070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc939-2a16-466a-aa99-dad557af10c5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:22.083794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc939-2a16-466a-aa99-dad557af10c5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:22.087904 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b01db-f05e-47c8-8512-d0a1b2a21502 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:22.089797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f32c-55bc-446d-94b1-271c3c4b83bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:22.090470 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f32c-55bc-446d-94b1-271c3c4b83bc admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.090754 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f32c-55bc-446d-94b1-271c3c4b83bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.091029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2f32c-55bc-446d-94b1-271c3c4b83bc admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.091675 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2f32c-55bc-446d-94b1-271c3c4b83bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:22.093900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2f32c-55bc-446d-94b1-271c3c4b83bc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:22.126479 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1385/2729] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:22 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:50:22.129583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:22.131409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f32c-55bc-446d-94b1-271c3c4b83bc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:22.146462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2f32c-55bc-446d-94b1-271c3c4b83bc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:22.151804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10086d3-09bd-4a2a-9dc2-a2cf503e6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:22.152444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10086d3-09bd-4a2a-9dc2-a2cf503e6c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.152721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10086d3-09bd-4a2a-9dc2-a2cf503e6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.152993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10086d3-09bd-4a2a-9dc2-a2cf503e6c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.153642 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10086d3-09bd-4a2a-9dc2-a2cf503e6c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:22.155425 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10086d3-09bd-4a2a-9dc2-a2cf503e6c93 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:22.159893 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f107f4-5dd6-43fd-97a5-a2c8e9b6d4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:22.160732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f107f4-5dd6-43fd-97a5-a2c8e9b6d4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.161314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f107f4-5dd6-43fd-97a5-a2c8e9b6d4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.162068 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f107f4-5dd6-43fd-97a5-a2c8e9b6d4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.172873 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1386/2730] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:22.175095 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f107f4-5dd6-43fd-97a5-a2c8e9b6d4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:22.176586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f107f4-5dd6-43fd-97a5-a2c8e9b6d4e0 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:22.177405 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10086d3-09bd-4a2a-9dc2-a2cf503e6c93 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:22.189283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1345/2731] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:22.194070 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10086d3-09bd-4a2a-9dc2-a2cf503e6c93 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:22.199303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e4d37-2314-4263-9cd0-fc8ebd41bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:22.200013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4d37-2314-4263-9cd0-fc8ebd41bf9f admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.200290 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4d37-2314-4263-9cd0-fc8ebd41bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.200563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e4d37-2314-4263-9cd0-fc8ebd41bf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.201242 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e4d37-2314-4263-9cd0-fc8ebd41bf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:22.202956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e4d37-2314-4263-9cd0-fc8ebd41bf9f admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:22.224770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1387/2732] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:22.226235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f107f4-5dd6-43fd-97a5-a2c8e9b6d4e0 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:22.237487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f107f4-5dd6-43fd-97a5-a2c8e9b6d4e0 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:22.242832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:22.243513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.243792 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.244273 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] PATH_INFO: `/v3/projects/25b6ffb5771c422d8c02a728ee14d168/users/21a88f5a3def477fabbf43f019882d80/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.281349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b6ffb5771c422d8c02a728ee14d168, user_id=21a88f5a3def477fabbf43f019882d80, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:22.283945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:22.300390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1346/2733] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:22 2022] PUT /identity/v3/projects/25b6ffb5771c422d8c02a728ee14d168/users/21a88f5a3def477fabbf43f019882d80/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:22.311424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce273-0bcd-4c38-8320-d26fd25d7a28 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.311646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce273-0bcd-4c38-8320-d26fd25d7a28 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.312911 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce273-0bcd-4c38-8320-d26fd25d7a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.343244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-873ce273-0bcd-4c38-8320-d26fd25d7a28 None None] MFA Rules not processed for user `21a88f5a3def477fabbf43f019882d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:22.344567 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-873ce273-0bcd-4c38-8320-d26fd25d7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:22.357720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:22.429563 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1388/2734] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:22.441062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:22.442967 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:22.517798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c67cf-527f-4b30-a148-c8766ca4957d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:22.521610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf657c3c-9ca4-44e1-9142-23330b3b9c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:22.522316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657c3c-9ca4-44e1-9142-23330b3b9c48 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.522702 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657c3c-9ca4-44e1-9142-23330b3b9c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.523048 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657c3c-9ca4-44e1-9142-23330b3b9c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.532845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf657c3c-9ca4-44e1-9142-23330b3b9c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:22.534399 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf657c3c-9ca4-44e1-9142-23330b3b9c48 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:22.545215 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1347/2735] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:22.556195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce273-0bcd-4c38-8320-d26fd25d7a28 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:22.557999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-873ce273-0bcd-4c38-8320-d26fd25d7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:22.636206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce273-0bcd-4c38-8320-d26fd25d7a28 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:22.641775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:22.642526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.642813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.643195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] PATH_INFO: `/v3/projects/d321c2e51717485f92adc797d75a811b` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.644487 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d321c2e51717485f92adc797d75a811b)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:22.647013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:22.716273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd321c2e51717485f92adc797d75a811b', 'request_id': 'req-8cf2ee73-30b5-4300-b228-486fd2ab0951'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:22.726596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd321c2e51717485f92adc797d75a811b', 'request_id': 'req-8cf2ee73-30b5-4300-b228-486fd2ab0951'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:22.733745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd321c2e51717485f92adc797d75a811b', 'request_id': 'req-8cf2ee73-30b5-4300-b228-486fd2ab0951'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:22.747712 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] The token cache is being invalidate because project d321c2e51717485f92adc797d75a811b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:22.747920 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:22.749424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8cf2ee73-30b5-4300-b228-486fd2ab0951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:22.751305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1389/2736] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:22 2022] DELETE /identity/v3/projects/d321c2e51717485f92adc797d75a811b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:22.757603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824aecf-5535-40b7-9467-117bdf7d5210 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.758067 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824aecf-5535-40b7-9467-117bdf7d5210 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.758535 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824aecf-5535-40b7-9467-117bdf7d5210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.780573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4824aecf-5535-40b7-9467-117bdf7d5210 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:22.782230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4824aecf-5535-40b7-9467-117bdf7d5210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:22.900218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1348/2737] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:22.908410 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877f1c-8bc3-4ffa-84be-062c01f01c0d None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.908696 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877f1c-8bc3-4ffa-84be-062c01f01c0d None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.908967 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877f1c-8bc3-4ffa-84be-062c01f01c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.946595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f1877f1c-8bc3-4ffa-84be-062c01f01c0d None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:22.947848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f1877f1c-8bc3-4ffa-84be-062c01f01c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:22.961629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1390/2738] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:22.962868 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824aecf-5535-40b7-9467-117bdf7d5210 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:22.974667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824aecf-5535-40b7-9467-117bdf7d5210 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:22.979975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:22.980597 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:22.980872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:22.981172 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:22.981830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:50:22.982127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:22.984212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:22.996679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1349/2739] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:50:23.001110 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877f1c-8bc3-4ffa-84be-062c01f01c0d None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:23.011341 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877f1c-8bc3-4ffa-84be-062c01f01c0d None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:23.016189 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883ef5-a4ae-44e3-bf07-7f217034d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:23.016807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883ef5-a4ae-44e3-bf07-7f217034d024 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:23.017083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883ef5-a4ae-44e3-bf07-7f217034d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:23.017352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c883ef5-a4ae-44e3-bf07-7f217034d024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:23.017997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c883ef5-a4ae-44e3-bf07-7f217034d024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:23.019962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c883ef5-a4ae-44e3-bf07-7f217034d024 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:23.050350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1391/2740] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:23 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:23.054556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:23.064507 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c655cd-4b04-48b8-b060-7e1edf0aeb52 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:23.110810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:23.126847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe617f-2022-4aa5-ae45-bb0fba659553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:23.127633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe617f-2022-4aa5-ae45-bb0fba659553 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:23.127915 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe617f-2022-4aa5-ae45-bb0fba659553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:23.128187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe617f-2022-4aa5-ae45-bb0fba659553 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:23.128829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe617f-2022-4aa5-ae45-bb0fba659553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:23.130798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe617f-2022-4aa5-ae45-bb0fba659553 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:23.154964 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1350/2741] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:23 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:23.159025 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883ef5-a4ae-44e3-bf07-7f217034d024 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:23.171056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c883ef5-a4ae-44e3-bf07-7f217034d024 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:23.177621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b49676-dcb1-404f-9f91-3cf77e30ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:23.178295 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b49676-dcb1-404f-9f91-3cf77e30ac94 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:23.178612 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b49676-dcb1-404f-9f91-3cf77e30ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:23.178881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b49676-dcb1-404f-9f91-3cf77e30ac94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:23.179552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b49676-dcb1-404f-9f91-3cf77e30ac94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:23.181166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b49676-dcb1-404f-9f91-3cf77e30ac94 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:23.192794 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1392/2742] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:23.196750 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe617f-2022-4aa5-ae45-bb0fba659553 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:23.207347 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe617f-2022-4aa5-ae45-bb0fba659553 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:23.212261 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc6596-0aad-4aee-978c-090703caf2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:23.212877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6596-0aad-4aee-978c-090703caf2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:23.213153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6596-0aad-4aee-978c-090703caf2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:23.213428 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6596-0aad-4aee-978c-090703caf2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:23.214087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc6596-0aad-4aee-978c-090703caf2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:23.215732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc6596-0aad-4aee-978c-090703caf2b2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:23.228521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1351/2743] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:23.237212 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b49676-dcb1-404f-9f91-3cf77e30ac94 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:23.240569 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:23.245119 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b49676-dcb1-404f-9f91-3cf77e30ac94 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:23.254128 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:23.255175 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:23.255735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:23.256178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] PATH_INFO: `/v3/projects/4bbb8bc7e4a749938b26a4737ba2737e/users/8982efb864af4a6ea89e3fd159e90741/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:23.275511 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bbb8bc7e4a749938b26a4737ba2737e, user_id=8982efb864af4a6ea89e3fd159e90741, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:23.278226 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:23.298987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1393/2744] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:23 2022] PUT /identity/v3/projects/4bbb8bc7e4a749938b26a4737ba2737e/users/8982efb864af4a6ea89e3fd159e90741/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:50:23.302012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd45733-ea8e-45cc-95e6-e40371bb1f5f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:23.302299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd45733-ea8e-45cc-95e6-e40371bb1f5f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:23.303124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd45733-ea8e-45cc-95e6-e40371bb1f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:23.325157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2cd45733-ea8e-45cc-95e6-e40371bb1f5f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:23.326338 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2cd45733-ea8e-45cc-95e6-e40371bb1f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:23.411239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1352/2745] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:23.427560 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:23.432981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:23.508125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8933-cc4c-4877-aad2-bae7eab99ad2 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:23.511770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051300f-0aa1-4432-82dd-21dc9297ab7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:23.512381 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051300f-0aa1-4432-82dd-21dc9297ab7b service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:23.512653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051300f-0aa1-4432-82dd-21dc9297ab7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:23.512916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051300f-0aa1-4432-82dd-21dc9297ab7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:23.522791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051300f-0aa1-4432-82dd-21dc9297ab7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:23.524214 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051300f-0aa1-4432-82dd-21dc9297ab7b service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:23.533666 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1394/2746] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:28.448230 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd45733-ea8e-45cc-95e6-e40371bb1f5f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:28.449727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2cd45733-ea8e-45cc-95e6-e40371bb1f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:28.465221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd45733-ea8e-45cc-95e6-e40371bb1f5f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:28.470308 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:28.470996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:28.471274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:28.471541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] PATH_INFO: `/v3/users/21a88f5a3def477fabbf43f019882d80` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:28.472784 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a88f5a3def477fabbf43f019882d80)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:28.475282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:28.553134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a88f5a3def477fabbf43f019882d80'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:28.572085 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a88f5a3def477fabbf43f019882d80'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:28.583429 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a88f5a3def477fabbf43f019882d80'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:28.584420 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a88f5a3def477fabbf43f019882d80'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:28.584926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-3005361d-c5c2-4c1a-bea8-7c8fc4b45096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a88f5a3def477fabbf43f019882d80'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:28.606278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1353/2747] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:28 2022] DELETE /identity/v3/users/21a88f5a3def477fabbf43f019882d80 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:28.611345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dac965-e950-471c-9121-c9cb68ce5e9c None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:28.611944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dac965-e950-471c-9121-c9cb68ce5e9c None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:28.611944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dac965-e950-471c-9121-c9cb68ce5e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:28.632677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-66dac965-e950-471c-9121-c9cb68ce5e9c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:28.633914 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-66dac965-e950-471c-9121-c9cb68ce5e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:28.697354 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249be-1c78-4003-9ec5-f2de5af6a0cd None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:28.697697 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249be-1c78-4003-9ec5-f2de5af6a0cd None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:28.698035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c249be-1c78-4003-9ec5-f2de5af6a0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:28.713844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1395/2748] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:28.724662 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dac965-e950-471c-9121-c9cb68ce5e9c None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:28.726353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-66dac965-e950-471c-9121-c9cb68ce5e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:28.747179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-52c249be-1c78-4003-9ec5-f2de5af6a0cd None None] MFA Rules not processed for user `8982efb864af4a6ea89e3fd159e90741`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:28.748667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-52c249be-1c78-4003-9ec5-f2de5af6a0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:28.788865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:28.794829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dac965-e950-471c-9121-c9cb68ce5e9c None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:28.800217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:28.801102 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:28.801360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:28.801619 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:28.812477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:28.814714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:28.827442 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1396/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:28.849315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1354/2750] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:28.853939 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:28.855363 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:28.873629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb789899-d027-4515-a802-5ea6b4c13059 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:28.879688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74bcb1-c13b-43ad-b2c7-c834f0cb77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:28.880815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74bcb1-c13b-43ad-b2c7-c834f0cb77c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:28.880815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74bcb1-c13b-43ad-b2c7-c834f0cb77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:28.881451 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74bcb1-c13b-43ad-b2c7-c834f0cb77c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:28.882125 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74bcb1-c13b-43ad-b2c7-c834f0cb77c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:28.884240 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74bcb1-c13b-43ad-b2c7-c834f0cb77c8 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:28.921221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1397/2751] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:28 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:28.927724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c249be-1c78-4003-9ec5-f2de5af6a0cd None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:28.947934 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c249be-1c78-4003-9ec5-f2de5af6a0cd None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.019147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c021e-f59e-4533-a536-3efa966fe125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.020023 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c021e-f59e-4533-a536-3efa966fe125 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.020407 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c021e-f59e-4533-a536-3efa966fe125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.020801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c021e-f59e-4533-a536-3efa966fe125 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.021519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c021e-f59e-4533-a536-3efa966fe125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.023613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c021e-f59e-4533-a536-3efa966fe125 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.050443 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1355/2752] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:28 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:29.053080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74bcb1-c13b-43ad-b2c7-c834f0cb77c8 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.062961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:29.068308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74bcb1-c13b-43ad-b2c7-c834f0cb77c8 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.077568 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.078200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.078519 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.078822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.079450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.082296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.094137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1398/2753] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:29.098959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c021e-f59e-4533-a536-3efa966fe125 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.110720 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c021e-f59e-4533-a536-3efa966fe125 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.117835 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3231fb-17ee-4644-bab6-8b7d32daf1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.118534 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3231fb-17ee-4644-bab6-8b7d32daf1da admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.118881 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3231fb-17ee-4644-bab6-8b7d32daf1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.119063 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3231fb-17ee-4644-bab6-8b7d32daf1da admin admin] PATH_INFO: `/v3/projects/e97e67c7f369410ab04fdbafcc35a256/users/ca3fade8b26c4ca9973acd581605ec4e/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.139331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3231fb-17ee-4644-bab6-8b7d32daf1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97e67c7f369410ab04fdbafcc35a256, user_id=ca3fade8b26c4ca9973acd581605ec4e, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.142612 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3231fb-17ee-4644-bab6-8b7d32daf1da admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.160767 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1356/2754] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:29 2022] PUT /identity/v3/projects/e97e67c7f369410ab04fdbafcc35a256/users/ca3fade8b26c4ca9973acd581605ec4e/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:29.162239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.162999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3231fb-17ee-4644-bab6-8b7d32daf1da admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.164408 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:29.182572 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb463e-7999-4272-8970-c462c8b1fde0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.240499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3231fb-17ee-4644-bab6-8b7d32daf1da admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.244518 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.245166 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec46e1-637c-4a31-a30b-bf554179dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.245301 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.245537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.245769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec46e1-637c-4a31-a30b-bf554179dc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.245875 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] PATH_INFO: `/v3/projects/25b6ffb5771c422d8c02a728ee14d168` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.246066 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec46e1-637c-4a31-a30b-bf554179dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.246299 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec46e1-637c-4a31-a30b-bf554179dc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.246961 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec46e1-637c-4a31-a30b-bf554179dc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.247311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b6ffb5771c422d8c02a728ee14d168)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.248675 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec46e1-637c-4a31-a30b-bf554179dc73 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.249444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.259131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1357/2755] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:50:29.263228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec46e1-637c-4a31-a30b-bf554179dc73 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.272971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec46e1-637c-4a31-a30b-bf554179dc73 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.277598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5797496-99e6-4b3d-a900-ca8dddb146d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.278396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797496-99e6-4b3d-a900-ca8dddb146d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.278686 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797496-99e6-4b3d-a900-ca8dddb146d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.278978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797496-99e6-4b3d-a900-ca8dddb146d2 admin admin] PATH_INFO: `/v3/projects/e97e67c7f369410ab04fdbafcc35a256/users/ca3fade8b26c4ca9973acd581605ec4e/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.281327 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5797496-99e6-4b3d-a900-ca8dddb146d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97e67c7f369410ab04fdbafcc35a256, user_id=ca3fade8b26c4ca9973acd581605ec4e, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.284198 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5797496-99e6-4b3d-a900-ca8dddb146d2 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.295465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1358/2756] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:29 2022] PUT /identity/v3/projects/e97e67c7f369410ab04fdbafcc35a256/users/ca3fade8b26c4ca9973acd581605ec4e/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:50:29.301441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b6ffb5771c422d8c02a728ee14d168', 'request_id': 'req-4019942f-b00e-4b71-84a9-c932d20b24ac'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:29.308239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b6ffb5771c422d8c02a728ee14d168', 'request_id': 'req-4019942f-b00e-4b71-84a9-c932d20b24ac'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:29.314677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b6ffb5771c422d8c02a728ee14d168', 'request_id': 'req-4019942f-b00e-4b71-84a9-c932d20b24ac'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:29.337455 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] The token cache is being invalidate because project 25b6ffb5771c422d8c02a728ee14d168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:29.337731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:29.338526 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4019942f-b00e-4b71-84a9-c932d20b24ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:29.342428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1399/2757] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:29 2022] DELETE /identity/v3/projects/25b6ffb5771c422d8c02a728ee14d168 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:50:29.346156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bcf33-c031-448c-9e64-0a224a2c5d49 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.346156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bcf33-c031-448c-9e64-0a224a2c5d49 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.346734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bcf33-c031-448c-9e64-0a224a2c5d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.368756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-523bcf33-c031-448c-9e64-0a224a2c5d49 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:29.370156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-523bcf33-c031-448c-9e64-0a224a2c5d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:29.382460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:29.458295 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1359/2758] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:29.466493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137ab1-6574-4f3e-b0e2-93e9df32fbe5 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.466868 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137ab1-6574-4f3e-b0e2-93e9df32fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.467146 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137ab1-6574-4f3e-b0e2-93e9df32fbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.492626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-f7137ab1-6574-4f3e-b0e2-93e9df32fbe5 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:29.494040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f7137ab1-6574-4f3e-b0e2-93e9df32fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:29.509120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1400/2759] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:29.514863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bcf33-c031-448c-9e64-0a224a2c5d49 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.526174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bcf33-c031-448c-9e64-0a224a2c5d49 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.533008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.533783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.534131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.534511 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.535237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:50:29.535608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.537331 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.553008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1360/2760] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:50:29.557032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137ab1-6574-4f3e-b0e2-93e9df32fbe5 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.568991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137ab1-6574-4f3e-b0e2-93e9df32fbe5 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.576199 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61f79c-3878-40b0-af65-906bd8e02895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.577876 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61f79c-3878-40b0-af65-906bd8e02895 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.578330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61f79c-3878-40b0-af65-906bd8e02895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.578818 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61f79c-3878-40b0-af65-906bd8e02895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.580195 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61f79c-3878-40b0-af65-906bd8e02895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.584859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61f79c-3878-40b0-af65-906bd8e02895 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.634432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1401/2761] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:29 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:29.637002 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.648061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde1e59-2a32-44e9-8b73-9c59467c703b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.730071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f829728-7154-46a5-b92e-6f5be98fa898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.730553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829728-7154-46a5-b92e-6f5be98fa898 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.730553 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829728-7154-46a5-b92e-6f5be98fa898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.731026 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829728-7154-46a5-b92e-6f5be98fa898 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.731425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f829728-7154-46a5-b92e-6f5be98fa898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.733779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f829728-7154-46a5-b92e-6f5be98fa898 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.768049 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1361/2762] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:29 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:29.771273 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61f79c-3878-40b0-af65-906bd8e02895 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.786340 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61f79c-3878-40b0-af65-906bd8e02895 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.795364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4960297-ddd4-4a96-b9e7-2b5e2984027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.795364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4960297-ddd4-4a96-b9e7-2b5e2984027e admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.796041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4960297-ddd4-4a96-b9e7-2b5e2984027e admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.796320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4960297-ddd4-4a96-b9e7-2b5e2984027e admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.797520 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4960297-ddd4-4a96-b9e7-2b5e2984027e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.799724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4960297-ddd4-4a96-b9e7-2b5e2984027e admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.814030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1402/2763] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:29.818167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f829728-7154-46a5-b92e-6f5be98fa898 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.831108 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f829728-7154-46a5-b92e-6f5be98fa898 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.837159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306653fa-8067-457c-a951-22ada108e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.837882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306653fa-8067-457c-a951-22ada108e062 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.838188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306653fa-8067-457c-a951-22ada108e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.838573 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306653fa-8067-457c-a951-22ada108e062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.839311 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306653fa-8067-457c-a951-22ada108e062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.841040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306653fa-8067-457c-a951-22ada108e062 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.858440 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1362/2764] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:29.859432 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4960297-ddd4-4a96-b9e7-2b5e2984027e admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:29.871394 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4960297-ddd4-4a96-b9e7-2b5e2984027e admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:29.877767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:29.878779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.879219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.879549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] PATH_INFO: `/v3/projects/f6bc6494562b4072b64380dfd9d52777/users/bfadbb9c13624c3c97d755988ffb3d7b/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.897617 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bc6494562b4072b64380dfd9d52777, user_id=bfadbb9c13624c3c97d755988ffb3d7b, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:29.900545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:29.930021 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1403/2765] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:29 2022] PUT /identity/v3/projects/f6bc6494562b4072b64380dfd9d52777/users/bfadbb9c13624c3c97d755988ffb3d7b/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:29.940453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27572b6-9b64-4d3f-9df5-1d8ade558d91 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:29.940773 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27572b6-9b64-4d3f-9df5-1d8ade558d91 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:29.940997 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27572b6-9b64-4d3f-9df5-1d8ade558d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:29.980952 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-b27572b6-9b64-4d3f-9df5-1d8ade558d91 None None] MFA Rules not processed for user `bfadbb9c13624c3c97d755988ffb3d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:29.982610 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-b27572b6-9b64-4d3f-9df5-1d8ade558d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.064474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1363/2766] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:30.077252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:30.079621 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.113466 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:30.172160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d5b35-7501-4306-9e5a-43b324ba3433 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:30.177388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba938e-4e0c-4264-959f-b27b8119b32d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:30.178017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba938e-4e0c-4264-959f-b27b8119b32d service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:30.178292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba938e-4e0c-4264-959f-b27b8119b32d service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:30.178976 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba938e-4e0c-4264-959f-b27b8119b32d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:30.190066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba938e-4e0c-4264-959f-b27b8119b32d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:30.191716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba938e-4e0c-4264-959f-b27b8119b32d service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:30.202535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1404/2767] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:30.230892 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27572b6-9b64-4d3f-9df5-1d8ade558d91 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:30.246257 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:30.320690 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27572b6-9b64-4d3f-9df5-1d8ade558d91 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:30.326960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054109-222a-4667-b777-700813400a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:30.327677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054109-222a-4667-b777-700813400a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:30.327924 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054109-222a-4667-b777-700813400a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:30.328202 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054109-222a-4667-b777-700813400a8c admin admin] PATH_INFO: `/v3/users/bfadbb9c13624c3c97d755988ffb3d7b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:30.329426 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93054109-222a-4667-b777-700813400a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfadbb9c13624c3c97d755988ffb3d7b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:30.331460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93054109-222a-4667-b777-700813400a8c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:30.400501 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93054109-222a-4667-b777-700813400a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfadbb9c13624c3c97d755988ffb3d7b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:30.423593 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93054109-222a-4667-b777-700813400a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfadbb9c13624c3c97d755988ffb3d7b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:30.433747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93054109-222a-4667-b777-700813400a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfadbb9c13624c3c97d755988ffb3d7b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:30.434701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93054109-222a-4667-b777-700813400a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfadbb9c13624c3c97d755988ffb3d7b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:30.435906 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-93054109-222a-4667-b777-700813400a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfadbb9c13624c3c97d755988ffb3d7b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:30.456218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1364/2768] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:30 2022] DELETE /identity/v3/users/bfadbb9c13624c3c97d755988ffb3d7b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:30.458191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906ebd3-fc5f-46f1-baf1-11d88ec20149 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:30.458688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906ebd3-fc5f-46f1-baf1-11d88ec20149 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:30.459062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906ebd3-fc5f-46f1-baf1-11d88ec20149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:30.485839 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9906ebd3-fc5f-46f1-baf1-11d88ec20149 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:30.487402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9906ebd3-fc5f-46f1-baf1-11d88ec20149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.588937 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1405/2769] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:30.596882 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054109-222a-4667-b777-700813400a8c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:30.599017 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-93054109-222a-4667-b777-700813400a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:30.669053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054109-222a-4667-b777-700813400a8c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:30.675905 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13c293-f34c-425b-98dd-4af9f737b8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:30.676551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c293-f34c-425b-98dd-4af9f737b8dd service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:30.676842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c293-f34c-425b-98dd-4af9f737b8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:30.677154 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c293-f34c-425b-98dd-4af9f737b8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:30.688611 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13c293-f34c-425b-98dd-4af9f737b8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:30.690075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13c293-f34c-425b-98dd-4af9f737b8dd service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:30.701791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1365/2770] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:31.005268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906ebd3-fc5f-46f1-baf1-11d88ec20149 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:31.008306 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9906ebd3-fc5f-46f1-baf1-11d88ec20149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:31.025739 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906ebd3-fc5f-46f1-baf1-11d88ec20149 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:31.032992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:31.034590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:31.035325 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:31.035836 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] PATH_INFO: `/v3/projects/f6bc6494562b4072b64380dfd9d52777` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:31.038024 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bc6494562b4072b64380dfd9d52777)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:31.040312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:31.101327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bc6494562b4072b64380dfd9d52777', 'request_id': 'req-4d247782-a91f-4f97-a244-7e88d152838c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:31.109545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bc6494562b4072b64380dfd9d52777', 'request_id': 'req-4d247782-a91f-4f97-a244-7e88d152838c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:31.120420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bc6494562b4072b64380dfd9d52777', 'request_id': 'req-4d247782-a91f-4f97-a244-7e88d152838c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:31.141763 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] The token cache is being invalidate because project f6bc6494562b4072b64380dfd9d52777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:31.142333 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:31.143220 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:31.145373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1406/2771] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:31 2022] DELETE /identity/v3/projects/f6bc6494562b4072b64380dfd9d52777 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:34.341125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e8a1-e289-4198-8c9a-e4fcdfbe92cb None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:34.341821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e8a1-e289-4198-8c9a-e4fcdfbe92cb None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:34.341821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e8a1-e289-4198-8c9a-e4fcdfbe92cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:34.372129 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c969e8a1-e289-4198-8c9a-e4fcdfbe92cb None None] MFA Rules not processed for user `ca3fade8b26c4ca9973acd581605ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:34.373405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c969e8a1-e289-4198-8c9a-e4fcdfbe92cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:34.395958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:34.463899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1366/2772] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:34.480236 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:34.482287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:34.559129 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:34.566666 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247782-a91f-4f97-a244-7e88d152838c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:34.574352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89357dc69c8f456580613061f2cbef07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:34.574884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:34.575157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:34.575421 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:34.577423 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:34.642253 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:34.643900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:34.655026 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1407/2773] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:34.781506 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1ac3-8ce0-4011-b902-49f2c322c95a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:34.781788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1ac3-8ce0-4011-b902-49f2c322c95a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:34.782137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1ac3-8ce0-4011-b902-49f2c322c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:34.803249 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-bd5c1ac3-8ce0-4011-b902-49f2c322c95a None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:34.804517 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-bd5c1ac3-8ce0-4011-b902-49f2c322c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:34.863441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1367/2774] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:34.891123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:34.892266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:34.997096 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84705a3-b146-4705-b3ff-afe82c79e5f6 service glance] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:35.003497 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:35.004142 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:35.004419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:35.004686 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:35.014618 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:35.016294 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:35.027760 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1408/2775] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:50:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:50:44.085458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae378-c74d-43db-8e64-fc2681c40357 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:44.086079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae378-c74d-43db-8e64-fc2681c40357 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:44.086079 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae378-c74d-43db-8e64-fc2681c40357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:44.107239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-a06ae378-c74d-43db-8e64-fc2681c40357 None None] MFA Rules not processed for user `8982efb864af4a6ea89e3fd159e90741`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:44.108523 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-a06ae378-c74d-43db-8e64-fc2681c40357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:44.116884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1368/2776] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:44.417121 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:44.418844 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:44.483699 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe6dc-dd23-4720-b7da-9a8d2468ae20 service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:44.489057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:44.490106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:44.490623 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:44.491266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:44.494650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:44.507893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:44.509368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:44.518625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1409/2777] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:46.222489 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553015-7bae-4cd2-a446-19c8b897c065 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:46.223045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553015-7bae-4cd2-a446-19c8b897c065 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:46.223188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553015-7bae-4cd2-a446-19c8b897c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:46.245211 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4c553015-7bae-4cd2-a446-19c8b897c065 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:46.246815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4c553015-7bae-4cd2-a446-19c8b897c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:46.256962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1369/2778] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Aug 30 14:50:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:46.270656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:46.285605 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31a83-31b2-4973-86a2-6b3af9382793 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:46.291505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:46.292115 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:46.292387 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:46.292653 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:46.301672 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:46.303289 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:46.318344 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1410/2779] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:50:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:50:46.618867 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c553015-7bae-4cd2-a446-19c8b897c065 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:46.640552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c553015-7bae-4cd2-a446-19c8b897c065 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:46.662297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:46.663900 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:46.665071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:46.665478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:46.687031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:46.817954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:46.820421 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:46.837224 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1370/2780] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:50:50.707903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:50.709715 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:50.742030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:50.794940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:50.797244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:50.815022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7772774-5d4c-41c1-9cc9-d44b7df2789d service swift] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:50.819607 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35296503-e99d-4a03-9d64-4f6f06bb7268 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:50.827949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:50.828879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:50.829162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:50.829431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] PATH_INFO: `/v3/users/5b64acf3f19a40ca869bf9070bad361b` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:50.830816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b64acf3f19a40ca869bf9070bad361b)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:50.833248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:50.835156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:50.835906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:50.836318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:50.836636 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:50.838680 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:50.852881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:50.856120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:50.878936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1411/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:50.914289 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:50.923667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b64acf3f19a40ca869bf9070bad361b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:50.937715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b64acf3f19a40ca869bf9070bad361b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:50.945759 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b64acf3f19a40ca869bf9070bad361b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:50.947045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b64acf3f19a40ca869bf9070bad361b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:50.947885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-7ba97e05-3fd8-4256-8837-64ebdd63fd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b64acf3f19a40ca869bf9070bad361b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:50.966416 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1371/2782] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:50:50 2022] DELETE /identity/v3/users/5b64acf3f19a40ca869bf9070bad361b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:50:51.220267 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:51.233409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007a3b7-7036-49e7-a657-a723465a7526 service placement] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:51.308191 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:51.308854 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.309132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.309401 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] PATH_INFO: `/v3/projects/3161456a45ae4d9fa1c6b2ab9a5c8ca2` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.310902 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3161456a45ae4d9fa1c6b2ab9a5c8ca2)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:51.313262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:51.373436 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3161456a45ae4d9fa1c6b2ab9a5c8ca2', 'request_id': 'req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:51.381386 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3161456a45ae4d9fa1c6b2ab9a5c8ca2', 'request_id': 'req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:51.388610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3161456a45ae4d9fa1c6b2ab9a5c8ca2', 'request_id': 'req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:51.403327 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] The token cache is being invalidate because project 3161456a45ae4d9fa1c6b2ab9a5c8ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:50:51.403609 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:51.404216 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ff7470dc-c222-4a92-ab1e-a10ced6c23e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:50:51.405971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1412/2783] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:50:51 2022] DELETE /identity/v3/projects/3161456a45ae4d9fa1c6b2ab9a5c8ca2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:51.411444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6a39-38a3-4c8e-94b1-432dcd235094 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.411731 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6a39-38a3-4c8e-94b1-432dcd235094 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.412031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6a39-38a3-4c8e-94b1-432dcd235094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.433966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-839c6a39-38a3-4c8e-94b1-432dcd235094 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:51.435415 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-839c6a39-38a3-4c8e-94b1-432dcd235094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:51.513282 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1372/2784] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:50:51.522320 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73c9c-f403-4e48-949c-a730a60e0035 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.522632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73c9c-f403-4e48-949c-a730a60e0035 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.522906 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73c9c-f403-4e48-949c-a730a60e0035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.545766 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-13f73c9c-f403-4e48-949c-a730a60e0035 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:51.547576 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-13f73c9c-f403-4e48-949c-a730a60e0035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:51.560896 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6a39-38a3-4c8e-94b1-432dcd235094 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:51.565904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1413/2785] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:51.571530 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6a39-38a3-4c8e-94b1-432dcd235094 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:51.576245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:51.576950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.577317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.577938 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.578159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:50:51.578492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:51.580136 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:51.596643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1373/2786] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 14:50:51.599534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73c9c-f403-4e48-949c-a730a60e0035 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:51.609896 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73c9c-f403-4e48-949c-a730a60e0035 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:51.614922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c589779-caf7-452e-9a3b-efbd710afa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:51.615632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c589779-caf7-452e-9a3b-efbd710afa9d admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.615907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c589779-caf7-452e-9a3b-efbd710afa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.616198 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c589779-caf7-452e-9a3b-efbd710afa9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.616861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c589779-caf7-452e-9a3b-efbd710afa9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:51.618819 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c589779-caf7-452e-9a3b-efbd710afa9d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:51.652847 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1414/2787] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:50:51 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:51.656617 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:51.667798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c1712-5110-4a57-9b4f-8ec41d64b0ec admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:51.727062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c68e7-28f1-4bac-83f3-d8cc93567c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:51.727718 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c68e7-28f1-4bac-83f3-d8cc93567c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.727969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c68e7-28f1-4bac-83f3-d8cc93567c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.728237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c68e7-28f1-4bac-83f3-d8cc93567c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.728917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c68e7-28f1-4bac-83f3-d8cc93567c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:51.730884 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c68e7-28f1-4bac-83f3-d8cc93567c0b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:51.755320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1374/2788] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:50:51 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:50:51.759761 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c589779-caf7-452e-9a3b-efbd710afa9d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:51.772187 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c589779-caf7-452e-9a3b-efbd710afa9d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:51.777262 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f30c3c-fac6-421c-bd5b-3ade4e89751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:51.777901 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30c3c-fac6-421c-bd5b-3ade4e89751c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.778169 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30c3c-fac6-421c-bd5b-3ade4e89751c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.778581 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f30c3c-fac6-421c-bd5b-3ade4e89751c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.779232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f30c3c-fac6-421c-bd5b-3ade4e89751c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:51.780934 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f30c3c-fac6-421c-bd5b-3ade4e89751c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:51.790027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:51.802731 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1415/2789] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:51.803498 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c68e7-28f1-4bac-83f3-d8cc93567c0b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:51.816288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c68e7-28f1-4bac-83f3-d8cc93567c0b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:51.821761 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57dd02-8d93-4af6-b312-74061073a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:51.822648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57dd02-8d93-4af6-b312-74061073a648 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.822941 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57dd02-8d93-4af6-b312-74061073a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.823206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57dd02-8d93-4af6-b312-74061073a648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.823930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57dd02-8d93-4af6-b312-74061073a648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:51.825790 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57dd02-8d93-4af6-b312-74061073a648 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:51.838317 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1375/2790] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:50:51.843660 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f30c3c-fac6-421c-bd5b-3ade4e89751c admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:51.855513 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f30c3c-fac6-421c-bd5b-3ade4e89751c admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:51.861549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:51.862564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.862987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.863317 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] PATH_INFO: `/v3/projects/64546e82b7d443ebad5fd3ba47ea7595/users/eedbb4dc8ff84150a9199e006e016b2c/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.879720 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64546e82b7d443ebad5fd3ba47ea7595, user_id=eedbb4dc8ff84150a9199e006e016b2c, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:51.882428 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:51.901461 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1416/2791] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:50:51 2022] PUT /identity/v3/projects/64546e82b7d443ebad5fd3ba47ea7595/users/eedbb4dc8ff84150a9199e006e016b2c/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:50:51.906848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce6bf-3e60-4c51-8d91-79f967c058b6 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:51.907145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce6bf-3e60-4c51-8d91-79f967c058b6 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:51.907396 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce6bf-3e60-4c51-8d91-79f967c058b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:51.937844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8d7ce6bf-3e60-4c51-8d91-79f967c058b6 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:51.943986 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8d7ce6bf-3e60-4c51-8d91-79f967c058b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:51.969237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:52.029474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1376/2792] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:52.036371 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:52.038134 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:52.104162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60e3bb-c70b-489d-9799-187a8607512d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:52.108917 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:52.109608 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:52.109970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:52.110246 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:52.120627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:52.122137 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:52.133017 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1417/2793] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:57.257569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09cd6-f397-4e00-9e65-43319228416e None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:57.258189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09cd6-f397-4e00-9e65-43319228416e None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:57.258189 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09cd6-f397-4e00-9e65-43319228416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:57.303061 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-f3b09cd6-f397-4e00-9e65-43319228416e None None] MFA Rules not processed for user `eedbb4dc8ff84150a9199e006e016b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:57.304269 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-f3b09cd6-f397-4e00-9e65-43319228416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:57.396463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1377/2794] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:50:57.415237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:50:57.416843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:57.529977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848001-317c-4277-96db-7add9fc29c2e service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:50:57.536574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c4cc0-7ccb-4b61-bf16-5847b95f7aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:50:57.537208 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4cc0-7ccb-4b61-bf16-5847b95f7aa2 service nova] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:57.537493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4cc0-7ccb-4b61-bf16-5847b95f7aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:57.537764 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4cc0-7ccb-4b61-bf16-5847b95f7aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:57.547443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c4cc0-7ccb-4b61-bf16-5847b95f7aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:50:57.549065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c4cc0-7ccb-4b61-bf16-5847b95f7aa2 service nova] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:50:57.560427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1418/2795] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:50:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:50:59.068206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba04e-f02d-434e-b088-6a76e9c6ed3a None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:50:59.068765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba04e-f02d-434e-b088-6a76e9c6ed3a None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:50:59.068765 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba04e-f02d-434e-b088-6a76e9c6ed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:50:59.088521 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-ba3ba04e-f02d-434e-b088-6a76e9c6ed3a None None] MFA Rules not processed for user `eedbb4dc8ff84150a9199e006e016b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:50:59.089730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ba3ba04e-f02d-434e-b088-6a76e9c6ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:50:59.097627 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1378/2796] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:51:07.554545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=70,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:07.673255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c4cc0-7ccb-4b61-bf16-5847b95f7aa2 service nova] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:51:07.683372 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c4cc0-7ccb-4b61-bf16-5847b95f7aa2 service nova] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:51:07.687254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e34ae1-8ddb-4b98-aa4f-2029954936d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:51:07.687849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e34ae1-8ddb-4b98-aa4f-2029954936d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:51:07.688275 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e34ae1-8ddb-4b98-aa4f-2029954936d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:51:07.688573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e34ae1-8ddb-4b98-aa4f-2029954936d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:51:07.690592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-40e34ae1-8ddb-4b98-aa4f-2029954936d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:51:07.764296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e34ae1-8ddb-4b98-aa4f-2029954936d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:51:07.765654 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e34ae1-8ddb-4b98-aa4f-2029954936d9 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:51:07.776630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1419/2797] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:51:09.082878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=52 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:09.561616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ba04e-f02d-434e-b088-6a76e9c6ed3a None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:51:09.564463 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ba3ba04e-f02d-434e-b088-6a76e9c6ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:51:09.586213 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ba04e-f02d-434e-b088-6a76e9c6ed3a None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:51:09.592994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:51:09.594649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:51:09.595125 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:51:09.595623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:51:09.597815 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:51:09.613837 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:51:09.616258 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:51:09.632824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1379/2798] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:51:17.771319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=30 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:19.624649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:53.054050 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef356f-60d1-47ce-ad09-ca6ef0257e17 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:51:53.054779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef356f-60d1-47ce-ad09-ca6ef0257e17 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:51:53.054779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef356f-60d1-47ce-ad09-ca6ef0257e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:51:53.085123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-70ef356f-60d1-47ce-ad09-ca6ef0257e17 None None] MFA Rules not processed for user `eedbb4dc8ff84150a9199e006e016b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:51:53.086354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-70ef356f-60d1-47ce-ad09-ca6ef0257e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:51:53.111686 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1420/2799] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:51:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:51:55.047430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:51:55.049829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:51:55.164234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23180bb-60b3-404e-b5d4-924f65aa05ed service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:51:55.170335 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:51:55.171098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:51:55.171377 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:51:55.171649 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] PATH_INFO: `/v3/users/b7ee9ecd521a458d9bbe1b62b3d3bb26` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:51:55.172848 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ee9ecd521a458d9bbe1b62b3d3bb26)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:51:55.174861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:51:55.239820 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ee9ecd521a458d9bbe1b62b3d3bb26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.255458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ee9ecd521a458d9bbe1b62b3d3bb26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.265425 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ee9ecd521a458d9bbe1b62b3d3bb26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.266187 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ee9ecd521a458d9bbe1b62b3d3bb26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.266922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ee9ecd521a458d9bbe1b62b3d3bb26'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.285589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1380/2800] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:51:55 2022] DELETE /identity/v3/users/b7ee9ecd521a458d9bbe1b62b3d3bb26 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:51:55.474908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef356f-60d1-47ce-ad09-ca6ef0257e17 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:51:55.487790 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef356f-60d1-47ce-ad09-ca6ef0257e17 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:51:55.569312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:51:55.569990 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:51:55.570258 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:51:55.570559 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] PATH_INFO: `/v3/projects/d81b13326ea84c77a2905448b031a6c0` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:51:55.571749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81b13326ea84c77a2905448b031a6c0)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:51:55.574414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:51:55.629192 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81b13326ea84c77a2905448b031a6c0', 'request_id': 'req-16dfb226-f712-4a9a-8aa6-3837821c9c47'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.637002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81b13326ea84c77a2905448b031a6c0', 'request_id': 'req-16dfb226-f712-4a9a-8aa6-3837821c9c47'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.643089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81b13326ea84c77a2905448b031a6c0', 'request_id': 'req-16dfb226-f712-4a9a-8aa6-3837821c9c47'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.659516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] The token cache is being invalidate because project d81b13326ea84c77a2905448b031a6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:51:55.659825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.660690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.663135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1421/2801] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:51:55 2022] DELETE /identity/v3/projects/d81b13326ea84c77a2905448b031a6c0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:51:55.667508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:51:55.670039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:51:55.684139 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665105-1749-4508-9da8-65a7104e1eec admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:51:55.749781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:51:55.750458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:51:55.750746 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:51:55.751188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] PATH_INFO: `/v3/users/bc9f7bdbfe91495cb3c7872670e0664a` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:51:55.752353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9f7bdbfe91495cb3c7872670e0664a)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:51:55.754293 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:51:55.768353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:55.811985 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9f7bdbfe91495cb3c7872670e0664a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.825145 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9f7bdbfe91495cb3c7872670e0664a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.833561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9f7bdbfe91495cb3c7872670e0664a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.834599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9f7bdbfe91495cb3c7872670e0664a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.835203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9f7bdbfe91495cb3c7872670e0664a'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:55.849748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1381/2802] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:51:55 2022] DELETE /identity/v3/users/bc9f7bdbfe91495cb3c7872670e0664a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:51:56.311688 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:51:56.313893 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:51:56.341318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfb226-f712-4a9a-8aa6-3837821c9c47 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:51:56.407477 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:56.414287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:51:56.415080 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:51:56.415276 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:51:56.415522 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] PATH_INFO: `/v3/projects/124ed46a97c74dfca9e57dc14faf1722` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:51:56.416724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=124ed46a97c74dfca9e57dc14faf1722)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:51:56.418814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:51:56.475491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124ed46a97c74dfca9e57dc14faf1722', 'request_id': 'req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:56.482435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124ed46a97c74dfca9e57dc14faf1722', 'request_id': 'req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:56.489312 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124ed46a97c74dfca9e57dc14faf1722', 'request_id': 'req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:56.508945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] The token cache is being invalidate because project 124ed46a97c74dfca9e57dc14faf1722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:51:56.509495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:56.510500 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6b7dbdf2-eb71-4f8a-83c8-c926420f1dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:51:56.512233 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1422/2803] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:51:56 2022] DELETE /identity/v3/projects/124ed46a97c74dfca9e57dc14faf1722 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:00.293887 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:00.295857 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:00.416088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e497466-24ba-422c-b3a1-2ff9d2e7e897 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:00.469748 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:00.482598 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:00.483227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:00.483508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:00.483797 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:00.485643 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:00.503616 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:00.505264 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:00.517466 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1382/2804] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:52:06.505595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:10.512197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:31.151225 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae3a9-3bda-434e-97a4-ecbcc7d11bd0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:31.151799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae3a9-3bda-434e-97a4-ecbcc7d11bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:31.151959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae3a9-3bda-434e-97a4-ecbcc7d11bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:31.185255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-a85ae3a9-3bda-434e-97a4-ecbcc7d11bd0 None None] MFA Rules not processed for user `a73f6352d0b04774bdf1ce68388cc940`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:31.186516 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a85ae3a9-3bda-434e-97a4-ecbcc7d11bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:31.256823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1423/2805] 10.222.0.49 () {58 vars in 967 bytes} [Tue Aug 30 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:52:31.305112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:31.306783 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:31.385467 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe3c2-4396-43c8-b99a-16c33ec0cd8e service placement] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:31.390670 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4639f179d4b4bb7b1fae6a8cf28d919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:31.391297 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:31.391576 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:31.391846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:31.401203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:31.402876 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:31.411830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1383/2806] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Aug 30 14:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 14:52:35.370602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ae3a9-3bda-434e-97a4-ecbcc7d11bd0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:35.372135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a85ae3a9-3bda-434e-97a4-ecbcc7d11bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:35.388538 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ae3a9-3bda-434e-97a4-ecbcc7d11bd0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:35.394042 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:35.394628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:35.394897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:35.395168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:35.397271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:35.410407 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:35.423040 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:35.435266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1424/2807] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:52:38.986794 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:38.988634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:39.075016 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7932c-8cda-4439-be67-b0aa12608ed0 service swift] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:39.080564 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:39.081326 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:39.081522 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:39.081796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] PATH_INFO: `/v3/users/8982efb864af4a6ea89e3fd159e90741` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:39.082998 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8982efb864af4a6ea89e3fd159e90741)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:39.084983 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:39.137722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8982efb864af4a6ea89e3fd159e90741'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.153561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8982efb864af4a6ea89e3fd159e90741'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.160834 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8982efb864af4a6ea89e3fd159e90741'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.161582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8982efb864af4a6ea89e3fd159e90741'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.162193 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8982efb864af4a6ea89e3fd159e90741'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.177479 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1384/2808] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:52:38 2022] DELETE /identity/v3/users/8982efb864af4a6ea89e3fd159e90741 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:39.373481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:39.386544 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d050-1bb9-4b2e-8894-a9a6d56a335f service placement] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:39.447961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:39.448603 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:39.448941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:39.449545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] PATH_INFO: `/v3/projects/4bbb8bc7e4a749938b26a4737ba2737e` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:39.450717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bbb8bc7e4a749938b26a4737ba2737e)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:39.452880 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:39.510691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bbb8bc7e4a749938b26a4737ba2737e', 'request_id': 'req-040fbe9b-0709-4947-911b-cad3a789ed58'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.517974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bbb8bc7e4a749938b26a4737ba2737e', 'request_id': 'req-040fbe9b-0709-4947-911b-cad3a789ed58'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.524982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bbb8bc7e4a749938b26a4737ba2737e', 'request_id': 'req-040fbe9b-0709-4947-911b-cad3a789ed58'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.539843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] The token cache is being invalidate because project 4bbb8bc7e4a749938b26a4737ba2737e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:52:39.540131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.540820 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.542354 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1425/2809] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:52:39 2022] DELETE /identity/v3/projects/4bbb8bc7e4a749938b26a4737ba2737e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:39.547337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:39.548866 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:39.563634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1926b-1c95-4b83-88e9-2d1ce433f78a admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:39.569122 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:39.634770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:39.635490 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:39.635808 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:39.636114 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] PATH_INFO: `/v3/users/ca3fade8b26c4ca9973acd581605ec4e` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:39.637374 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3fade8b26c4ca9973acd581605ec4e)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:39.639538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:39.698735 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3fade8b26c4ca9973acd581605ec4e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.712495 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3fade8b26c4ca9973acd581605ec4e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.720414 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3fade8b26c4ca9973acd581605ec4e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.721246 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3fade8b26c4ca9973acd581605ec4e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.721962 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f05c8456-8697-4d56-951b-c4782457dd4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3fade8b26c4ca9973acd581605ec4e'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:39.738096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1385/2810] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:52:39 2022] DELETE /identity/v3/users/ca3fade8b26c4ca9973acd581605ec4e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:52:39.954517 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:52:39.956774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:39.973745 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fbe9b-0709-4947-911b-cad3a789ed58 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:52:39.979871 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:40.069211 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:52:40.070638 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:40.070980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:40.071219 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] PATH_INFO: `/v3/projects/e97e67c7f369410ab04fdbafcc35a256` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:40.072687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97e67c7f369410ab04fdbafcc35a256)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:52:40.074841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:52:40.144271 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97e67c7f369410ab04fdbafcc35a256', 'request_id': 'req-5bd56708-3d28-4c93-9941-3a8555944f52'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:40.153107 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97e67c7f369410ab04fdbafcc35a256', 'request_id': 'req-5bd56708-3d28-4c93-9941-3a8555944f52'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:40.163093 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97e67c7f369410ab04fdbafcc35a256', 'request_id': 'req-5bd56708-3d28-4c93-9941-3a8555944f52'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:40.177398 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] The token cache is being invalidate because project e97e67c7f369410ab04fdbafcc35a256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:52:40.177718 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:40.178433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-5bd56708-3d28-4c93-9941-3a8555944f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:52:40.180987 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1426/2811] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:52:39 2022] DELETE /identity/v3/projects/e97e67c7f369410ab04fdbafcc35a256 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:52:49.734212 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:50.174074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:54.048991 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c54e-fe47-45ab-ac99-f05791da6f76 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:52:54.049582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c54e-fe47-45ab-ac99-f05791da6f76 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:52:54.049582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c54e-fe47-45ab-ac99-f05791da6f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:52:54.073098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e249c54e-fe47-45ab-ac99-f05791da6f76 None None] MFA Rules not processed for user `eedbb4dc8ff84150a9199e006e016b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:52:54.075130 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e249c54e-fe47-45ab-ac99-f05791da6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:52:54.137788 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1386/2812] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:52:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:53:04.130410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=25 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:50.775613 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7909-5cb1-4963-9dea-f8496b8d51a0 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:53:50.776217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7909-5cb1-4963-9dea-f8496b8d51a0 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:53:50.776217 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7909-5cb1-4963-9dea-f8496b8d51a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:53:50.797686 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-7aee7909-5cb1-4963-9dea-f8496b8d51a0 None None] MFA Rules not processed for user `eedbb4dc8ff84150a9199e006e016b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:53:50.798961 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7aee7909-5cb1-4963-9dea-f8496b8d51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:53:50.806201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1427/2813] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:53:50.847398 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c54e-fe47-45ab-ac99-f05791da6f76 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:53:50.848914 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e249c54e-fe47-45ab-ac99-f05791da6f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:53:50.909296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c54e-fe47-45ab-ac99-f05791da6f76 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:53:50.913203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89357dc69c8f456580613061f2cbef07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:53:50.913812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:53:50.914084 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:53:50.914349 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:53:50.916978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:53:51.011532 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:53:51.012970 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:53:51.036314 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1387/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:53:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:53:51.691416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7909-5cb1-4963-9dea-f8496b8d51a0 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:53:51.693339 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-7aee7909-5cb1-4963-9dea-f8496b8d51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:53:51.778897 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7909-5cb1-4963-9dea-f8496b8d51a0 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:53:51.782543 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:53:51.783166 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:53:51.783438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:53:51.783735 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:53:51.785473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:53:51.800178 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:53:51.801622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:53:51.820161 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1428/2815] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:53:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:01.033236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=63 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:01.809224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=38 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:45.883966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:45.885883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:45.911404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f90aa1-554d-4685-9706-5e3f6f31c038 service glance] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:45.917580 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:45.918300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:45.918667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:45.919248 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:45.921350 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:45.935476 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:45.940478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:45.965216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1388/2816] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:54:54.991446 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:54.992975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:55.071116 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70134021-daea-43b1-ae80-92485d1da3f0 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:55.076296 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:55.076948 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:55.077222 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:55.077493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] PATH_INFO: `/v3/users/eedbb4dc8ff84150a9199e006e016b2c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:55.078646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eedbb4dc8ff84150a9199e006e016b2c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:55.080575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:55.133762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eedbb4dc8ff84150a9199e006e016b2c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.148596 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eedbb4dc8ff84150a9199e006e016b2c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.149334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eedbb4dc8ff84150a9199e006e016b2c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.149942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eedbb4dc8ff84150a9199e006e016b2c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.159590 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-8f409e63-5b95-4c6d-9635-6ebdefab862c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eedbb4dc8ff84150a9199e006e016b2c'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.176153 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1429/2817] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:54:54 2022] DELETE /identity/v3/users/eedbb4dc8ff84150a9199e006e016b2c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:54:55.394586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:55.405996 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e1a6-e058-4b88-acf1-e03479b81046 service nova] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:55.473191 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:55.473860 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:55.474141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:55.474456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] PATH_INFO: `/v3/projects/64546e82b7d443ebad5fd3ba47ea7595` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:55.476348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64546e82b7d443ebad5fd3ba47ea7595)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:55.478713 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:55.536524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64546e82b7d443ebad5fd3ba47ea7595', 'request_id': 'req-ea8034fc-e915-4795-8c44-327e4b9a878c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.543944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64546e82b7d443ebad5fd3ba47ea7595', 'request_id': 'req-ea8034fc-e915-4795-8c44-327e4b9a878c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.551929 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64546e82b7d443ebad5fd3ba47ea7595', 'request_id': 'req-ea8034fc-e915-4795-8c44-327e4b9a878c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.564430 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] The token cache is being invalidate because project 64546e82b7d443ebad5fd3ba47ea7595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:54:55.564715 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.565376 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ea8034fc-e915-4795-8c44-327e4b9a878c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:54:55.566945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1389/2818] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:54:55 2022] DELETE /identity/v3/projects/64546e82b7d443ebad5fd3ba47ea7595 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:54:55.572480 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a454-d353-4191-a1f0-f64b5e6357c9 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:55.572762 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a454-d353-4191-a1f0-f64b5e6357c9 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:55.573032 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a454-d353-4191-a1f0-f64b5e6357c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:55.645993 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5ac3a454-d353-4191-a1f0-f64b5e6357c9 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:55.647310 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5ac3a454-d353-4191-a1f0-f64b5e6357c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:55.695264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:55.714730 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1430/2819] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:55.723706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4706-c75b-4e9c-bb9a-9aa6560eff49 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:55.723995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4706-c75b-4e9c-bb9a-9aa6560eff49 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:55.724346 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4706-c75b-4e9c-bb9a-9aa6560eff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:55.747245 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-adde4706-c75b-4e9c-bb9a-9aa6560eff49 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:55.748548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-adde4706-c75b-4e9c-bb9a-9aa6560eff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:55.757844 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1390/2820] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:55.762571 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3a454-d353-4191-a1f0-f64b5e6357c9 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:55.776000 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3a454-d353-4191-a1f0-f64b5e6357c9 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:55.781472 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:55.782090 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:55.782368 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:55.782665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:55.783322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:54:55.783624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:55.785241 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:55.799784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1431/2821] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:54:55.804810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4706-c75b-4e9c-bb9a-9aa6560eff49 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:55.816504 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4706-c75b-4e9c-bb9a-9aa6560eff49 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:55.823691 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d7bc-7b1b-4110-b141-311220c2722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:55.824551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d7bc-7b1b-4110-b141-311220c2722b admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:55.824917 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d7bc-7b1b-4110-b141-311220c2722b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:55.825353 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d7bc-7b1b-4110-b141-311220c2722b admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:55.826278 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521d7bc-7b1b-4110-b141-311220c2722b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:55.829150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521d7bc-7b1b-4110-b141-311220c2722b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:55.870826 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1391/2822] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:54:55 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:54:55.875949 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:55.891646 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56c5b8-a1f8-4b42-be32-966bb67fb9e5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:55.959779 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6083b-a692-434a-9d87-37e46a635ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:55.960393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6083b-a692-434a-9d87-37e46a635ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:55.960671 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6083b-a692-434a-9d87-37e46a635ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:55.960945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6083b-a692-434a-9d87-37e46a635ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:55.961583 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6083b-a692-434a-9d87-37e46a635ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:55.963540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6083b-a692-434a-9d87-37e46a635ed4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:55.993857 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1432/2823] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:54:55 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:54:55.998546 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d7bc-7b1b-4110-b141-311220c2722b admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:56.010925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d7bc-7b1b-4110-b141-311220c2722b admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:56.018167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89616a-0ddc-42f9-8d69-2e33598ca484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:56.018842 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89616a-0ddc-42f9-8d69-2e33598ca484 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:56.019119 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89616a-0ddc-42f9-8d69-2e33598ca484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:56.019389 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89616a-0ddc-42f9-8d69-2e33598ca484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:56.020042 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89616a-0ddc-42f9-8d69-2e33598ca484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:56.022005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89616a-0ddc-42f9-8d69-2e33598ca484 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:56.033603 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1392/2824] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:54:56.038916 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6083b-a692-434a-9d87-37e46a635ed4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:56.050013 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6083b-a692-434a-9d87-37e46a635ed4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:56.056774 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d042a-050f-4b64-8ded-68688fc6ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:56.057508 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d042a-050f-4b64-8ded-68688fc6ff24 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:56.057799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d042a-050f-4b64-8ded-68688fc6ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:56.058046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d042a-050f-4b64-8ded-68688fc6ff24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:56.058770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d042a-050f-4b64-8ded-68688fc6ff24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:56.060435 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d042a-050f-4b64-8ded-68688fc6ff24 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:56.072825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1433/2825] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:54:56.078054 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89616a-0ddc-42f9-8d69-2e33598ca484 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:56.088993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89616a-0ddc-42f9-8d69-2e33598ca484 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:56.093935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:56.094630 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:56.094902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:56.095174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] PATH_INFO: `/v3/projects/faaaecb980c649849c06772f1e09fbbe/users/607e8d19a5734f628ae5aa270a2e5576/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:56.111406 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaaecb980c649849c06772f1e09fbbe, user_id=607e8d19a5734f628ae5aa270a2e5576, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:56.114062 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:56.130408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1393/2826] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:54:56 2022] PUT /identity/v3/projects/faaaecb980c649849c06772f1e09fbbe/users/607e8d19a5734f628ae5aa270a2e5576/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:54:56.141981 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fba1bc-8433-4479-a875-e84b6ab44211 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:56.142268 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fba1bc-8433-4479-a875-e84b6ab44211 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:56.142573 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fba1bc-8433-4479-a875-e84b6ab44211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:56.171527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-c3fba1bc-8433-4479-a875-e84b6ab44211 None None] MFA Rules not processed for user `607e8d19a5734f628ae5aa270a2e5576`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:54:56.172742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c3fba1bc-8433-4479-a875-e84b6ab44211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:56.247729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1434/2827] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:54:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:54:56.259508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:54:56.261910 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:54:56.269589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:56.351302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438b23-c47f-4b65-bc34-6498df162ecd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:54:56.356995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ba245-c9a7-49b5-bb2f-dd30bb0bdaf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '906464ed50294dc481c4d1d570a5195b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:54:56.357798 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ba245-c9a7-49b5-bb2f-dd30bb0bdaf3 service nova] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:54:56.358077 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ba245-c9a7-49b5-bb2f-dd30bb0bdaf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:54:56.358348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ba245-c9a7-49b5-bb2f-dd30bb0bdaf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:54:56.366928 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ba245-c9a7-49b5-bb2f-dd30bb0bdaf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:54:56.368513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ba245-c9a7-49b5-bb2f-dd30bb0bdaf3 service nova] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:54:56.377382 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1394/2828] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:01.710492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fba1bc-8433-4479-a875-e84b6ab44211 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:01.759960 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:01.781507 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fba1bc-8433-4479-a875-e84b6ab44211 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:01.786881 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:01.787530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:01.787821 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:01.788103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] PATH_INFO: `/v3/users/607e8d19a5734f628ae5aa270a2e5576` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:01.789982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=607e8d19a5734f628ae5aa270a2e5576)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:01.791872 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:01.842729 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607e8d19a5734f628ae5aa270a2e5576'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:01.855334 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607e8d19a5734f628ae5aa270a2e5576'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:01.856057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607e8d19a5734f628ae5aa270a2e5576'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:01.856657 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607e8d19a5734f628ae5aa270a2e5576'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:01.864969 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607e8d19a5734f628ae5aa270a2e5576'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:01.881156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1435/2829] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:01 2022] DELETE /identity/v3/users/607e8d19a5734f628ae5aa270a2e5576 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:01.888737 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8eae-eb93-4dc0-ad03-238a72fd9b71 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:01.889722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8eae-eb93-4dc0-ad03-238a72fd9b71 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:01.890057 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8eae-eb93-4dc0-ad03-238a72fd9b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:01.916770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-73aa8eae-eb93-4dc0-ad03-238a72fd9b71 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:01.917940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-73aa8eae-eb93-4dc0-ad03-238a72fd9b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:01.989921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1395/2830] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:02.003283 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:02.005615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:02.072244 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0c5f-5417-4590-8bab-b01dcaee7576 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:02.076553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e6ea-d16c-4d24-8499-10031b082329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:02.077163 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e6ea-d16c-4d24-8499-10031b082329 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.077411 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e6ea-d16c-4d24-8499-10031b082329 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.077691 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e6ea-d16c-4d24-8499-10031b082329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.087985 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e6ea-d16c-4d24-8499-10031b082329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:02.089414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e6ea-d16c-4d24-8499-10031b082329 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:02.099355 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1436/2831] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:02.389153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa8eae-eb93-4dc0-ad03-238a72fd9b71 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:02.390766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-73aa8eae-eb93-4dc0-ad03-238a72fd9b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:02.407352 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa8eae-eb93-4dc0-ad03-238a72fd9b71 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:02.416599 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:02.417262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.418124 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.418423 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] PATH_INFO: `/v3/projects/faaaecb980c649849c06772f1e09fbbe` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.419852 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faaaecb980c649849c06772f1e09fbbe)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:02.421828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:02.479847 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faaaecb980c649849c06772f1e09fbbe', 'request_id': 'req-dbb24158-a9d5-46bd-8080-a13a8e0c0402'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:02.486849 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faaaecb980c649849c06772f1e09fbbe', 'request_id': 'req-dbb24158-a9d5-46bd-8080-a13a8e0c0402'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:02.497333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faaaecb980c649849c06772f1e09fbbe', 'request_id': 'req-dbb24158-a9d5-46bd-8080-a13a8e0c0402'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:02.509014 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] The token cache is being invalidate because project faaaecb980c649849c06772f1e09fbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:02.509244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:02.509960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-dbb24158-a9d5-46bd-8080-a13a8e0c0402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:02.511589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1396/2832] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:02 2022] DELETE /identity/v3/projects/faaaecb980c649849c06772f1e09fbbe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:02.517258 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef1b2b-02a7-4dac-acd6-5b5ba9796dc3 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.517540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef1b2b-02a7-4dac-acd6-5b5ba9796dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.517806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef1b2b-02a7-4dac-acd6-5b5ba9796dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.538441 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-5bef1b2b-02a7-4dac-acd6-5b5ba9796dc3 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:02.540551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-5bef1b2b-02a7-4dac-acd6-5b5ba9796dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:02.613314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1437/2833] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:02.621946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7abb7-6667-4dae-b0ff-67b58a91f3ab None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.622229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7abb7-6667-4dae-b0ff-67b58a91f3ab None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.622536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7abb7-6667-4dae-b0ff-67b58a91f3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.644701 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-91c7abb7-6667-4dae-b0ff-67b58a91f3ab None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:02.645942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-91c7abb7-6667-4dae-b0ff-67b58a91f3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:02.655966 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1397/2834] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:02.660438 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef1b2b-02a7-4dac-acd6-5b5ba9796dc3 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:02.673397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef1b2b-02a7-4dac-acd6-5b5ba9796dc3 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:02.681200 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:02.681784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.682083 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.682353 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.683010 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:55:02.683335 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:02.684955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:02.686530 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:02.703804 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1438/2835] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:55:02.704994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7abb7-6667-4dae-b0ff-67b58a91f3ab None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:02.714994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7abb7-6667-4dae-b0ff-67b58a91f3ab None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:02.720728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10c1f-3e16-4a84-84af-007fbf4ee0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:02.721337 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10c1f-3e16-4a84-84af-007fbf4ee0cd admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.721613 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10c1f-3e16-4a84-84af-007fbf4ee0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.721878 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10c1f-3e16-4a84-84af-007fbf4ee0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.722548 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d10c1f-3e16-4a84-84af-007fbf4ee0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:02.724458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d10c1f-3e16-4a84-84af-007fbf4ee0cd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:02.729567 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:02.757035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1398/2836] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:02 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:55:02.763586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:02.779308 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953a1f-1cd2-41d0-9d05-a71b8fe3b427 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:02.842927 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec758-f5d9-453c-85a2-3208a36b6e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:02.843545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec758-f5d9-453c-85a2-3208a36b6e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.843823 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec758-f5d9-453c-85a2-3208a36b6e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.844092 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec758-f5d9-453c-85a2-3208a36b6e76 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.844725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec758-f5d9-453c-85a2-3208a36b6e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:02.846681 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec758-f5d9-453c-85a2-3208a36b6e76 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:02.871165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1439/2837] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:02 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:02.875169 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10c1f-3e16-4a84-84af-007fbf4ee0cd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:02.886168 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10c1f-3e16-4a84-84af-007fbf4ee0cd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:02.891689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821ea89-f7ca-4d39-9721-f5b7190ee7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:02.892340 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821ea89-f7ca-4d39-9721-f5b7190ee7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.892559 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821ea89-f7ca-4d39-9721-f5b7190ee7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.892829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821ea89-f7ca-4d39-9721-f5b7190ee7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.893478 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821ea89-f7ca-4d39-9721-f5b7190ee7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:02.895135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821ea89-f7ca-4d39-9721-f5b7190ee7a1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:02.905935 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1399/2838] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:02.910228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec758-f5d9-453c-85a2-3208a36b6e76 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:02.922426 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec758-f5d9-453c-85a2-3208a36b6e76 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:02.928778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96312c3-a6f6-44a2-8ac3-bdfcf8e24004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:02.929373 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96312c3-a6f6-44a2-8ac3-bdfcf8e24004 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.929694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96312c3-a6f6-44a2-8ac3-bdfcf8e24004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.930120 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96312c3-a6f6-44a2-8ac3-bdfcf8e24004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.930884 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96312c3-a6f6-44a2-8ac3-bdfcf8e24004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:02.932467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96312c3-a6f6-44a2-8ac3-bdfcf8e24004 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:02.944227 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1440/2839] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 14:55:02.949315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821ea89-f7ca-4d39-9721-f5b7190ee7a1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:02.959829 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821ea89-f7ca-4d39-9721-f5b7190ee7a1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:02.964810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7a80d-514d-4a5a-8ea0-5a116a9c84ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:02.965465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7a80d-514d-4a5a-8ea0-5a116a9c84ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:02.965728 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7a80d-514d-4a5a-8ea0-5a116a9c84ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:02.966006 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7a80d-514d-4a5a-8ea0-5a116a9c84ef admin admin] PATH_INFO: `/v3/projects/cdf6f341c5864f17871f30255749f38c/users/cfcffbc9b54344ed83f3e0efecae8f24/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:02.983023 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7a80d-514d-4a5a-8ea0-5a116a9c84ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf6f341c5864f17871f30255749f38c, user_id=cfcffbc9b54344ed83f3e0efecae8f24, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:02.985667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7a80d-514d-4a5a-8ea0-5a116a9c84ef admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:03.000542 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1400/2840] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:02 2022] PUT /identity/v3/projects/cdf6f341c5864f17871f30255749f38c/users/cfcffbc9b54344ed83f3e0efecae8f24/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:03.013852 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d720292-f831-47fe-ae49-261212e2c149 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.014079 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d720292-f831-47fe-ae49-261212e2c149 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.014305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d720292-f831-47fe-ae49-261212e2c149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.047822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9d720292-f831-47fe-ae49-261212e2c149 None None] MFA Rules not processed for user `cfcffbc9b54344ed83f3e0efecae8f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:03.049072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9d720292-f831-47fe-ae49-261212e2c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:03.122132 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1441/2841] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:03.126776 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7a80d-514d-4a5a-8ea0-5a116a9c84ef admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:03.198989 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7a80d-514d-4a5a-8ea0-5a116a9c84ef admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:03.203919 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206f86-9f42-4fc7-84b9-aa87c8888dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:03.204538 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206f86-9f42-4fc7-84b9-aa87c8888dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.204816 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206f86-9f42-4fc7-84b9-aa87c8888dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.205052 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206f86-9f42-4fc7-84b9-aa87c8888dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.205727 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60206f86-9f42-4fc7-84b9-aa87c8888dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:03.207677 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60206f86-9f42-4fc7-84b9-aa87c8888dbd admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:03.237771 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1401/2842] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:03 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:03.243574 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d720292-f831-47fe-ae49-261212e2c149 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:03.254992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d720292-f831-47fe-ae49-261212e2c149 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:03.319089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964451e0-a3f8-4f4e-8770-484a1a2fccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:03.319740 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964451e0-a3f8-4f4e-8770-484a1a2fccb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.320023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964451e0-a3f8-4f4e-8770-484a1a2fccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.320329 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964451e0-a3f8-4f4e-8770-484a1a2fccb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.321658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964451e0-a3f8-4f4e-8770-484a1a2fccb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:03.323736 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964451e0-a3f8-4f4e-8770-484a1a2fccb4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:03.333690 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:03.349277 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1442/2843] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:03 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:03.353822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206f86-9f42-4fc7-84b9-aa87c8888dbd admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:03.369177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206f86-9f42-4fc7-84b9-aa87c8888dbd admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:03.374993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d556-17df-4808-9cad-2ede5da9c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:03.375596 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d556-17df-4808-9cad-2ede5da9c636 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.375879 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d556-17df-4808-9cad-2ede5da9c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.376150 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d556-17df-4808-9cad-2ede5da9c636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.376802 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d556-17df-4808-9cad-2ede5da9c636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:03.378460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d556-17df-4808-9cad-2ede5da9c636 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:03.389763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1402/2844] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:03.394388 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964451e0-a3f8-4f4e-8770-484a1a2fccb4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:03.405020 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964451e0-a3f8-4f4e-8770-484a1a2fccb4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:03.410771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b907cd-732d-4ea7-8bbf-7b0a2371d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:03.411437 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b907cd-732d-4ea7-8bbf-7b0a2371d76d admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.411719 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b907cd-732d-4ea7-8bbf-7b0a2371d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.411985 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b907cd-732d-4ea7-8bbf-7b0a2371d76d admin admin] PATH_INFO: `/v3/projects/e43b653742df42679896e7b16c1a32d3/users/7ca531fd8db748d58d59ca386f4a7133/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.428549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b907cd-732d-4ea7-8bbf-7b0a2371d76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43b653742df42679896e7b16c1a32d3, user_id=7ca531fd8db748d58d59ca386f4a7133, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:03.431357 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b907cd-732d-4ea7-8bbf-7b0a2371d76d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:03.446558 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1443/2845] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:03 2022] PUT /identity/v3/projects/e43b653742df42679896e7b16c1a32d3/users/7ca531fd8db748d58d59ca386f4a7133/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:03.450890 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d556-17df-4808-9cad-2ede5da9c636 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:03.461653 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d556-17df-4808-9cad-2ede5da9c636 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:03.529994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22b3eb-2f75-4669-93e5-57aa2abe295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:03.530654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b3eb-2f75-4669-93e5-57aa2abe295e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.530937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b3eb-2f75-4669-93e5-57aa2abe295e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.531209 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b3eb-2f75-4669-93e5-57aa2abe295e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.531858 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22b3eb-2f75-4669-93e5-57aa2abe295e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:03.533513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22b3eb-2f75-4669-93e5-57aa2abe295e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:03.544216 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1403/2846] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:03.548694 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b907cd-732d-4ea7-8bbf-7b0a2371d76d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:03.560022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b907cd-732d-4ea7-8bbf-7b0a2371d76d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:03.565599 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:03.566254 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.566580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.566859 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] PATH_INFO: `/v3/projects/e43b653742df42679896e7b16c1a32d3/users/7ca531fd8db748d58d59ca386f4a7133/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.569348 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43b653742df42679896e7b16c1a32d3, user_id=7ca531fd8db748d58d59ca386f4a7133, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:03.575015 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:03.586245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1444/2847] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:03 2022] PUT /identity/v3/projects/e43b653742df42679896e7b16c1a32d3/users/7ca531fd8db748d58d59ca386f4a7133/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:03.596950 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3cfd-da3c-4b1c-a975-1844de3d914f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.597235 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3cfd-da3c-4b1c-a975-1844de3d914f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.597509 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3cfd-da3c-4b1c-a975-1844de3d914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.628011 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-fe9b3cfd-da3c-4b1c-a975-1844de3d914f None None] MFA Rules not processed for user `7ca531fd8db748d58d59ca386f4a7133`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:03.629236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-fe9b3cfd-da3c-4b1c-a975-1844de3d914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:03.639474 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:03.709485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1404/2848] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:03.721337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:03.723305 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:03.809243 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b17ae8-e648-4e9e-b652-1028f266ddf1 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:03.814282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a598-df79-4b36-9b26-af205b00f844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:03.814994 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a598-df79-4b36-9b26-af205b00f844 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.815284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a598-df79-4b36-9b26-af205b00f844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.815552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a598-df79-4b36-9b26-af205b00f844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:03.827203 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a598-df79-4b36-9b26-af205b00f844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:03.828575 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a598-df79-4b36-9b26-af205b00f844 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:03.839374 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1445/2849] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:03.926694 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b3cfd-da3c-4b1c-a975-1844de3d914f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:03.938021 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b3cfd-da3c-4b1c-a975-1844de3d914f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:03.942012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfffac4-47fc-4e19-b2db-935cebf341c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:03.942657 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfffac4-47fc-4e19-b2db-935cebf341c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:03.942937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfffac4-47fc-4e19-b2db-935cebf341c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:03.943208 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfffac4-47fc-4e19-b2db-935cebf341c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:04.003664 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfffac4-47fc-4e19-b2db-935cebf341c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:04.005135 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfffac4-47fc-4e19-b2db-935cebf341c4 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:04.014465 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1405/2850] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:06.855678 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a598-df79-4b36-9b26-af205b00f844 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:06.953450 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a598-df79-4b36-9b26-af205b00f844 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:06.958414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:06.959170 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:06.959431 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:06.959711 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] PATH_INFO: `/v3/users/cfcffbc9b54344ed83f3e0efecae8f24` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:06.960887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcffbc9b54344ed83f3e0efecae8f24)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:06.963048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:07.011105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:07.019174 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcffbc9b54344ed83f3e0efecae8f24'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.041972 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcffbc9b54344ed83f3e0efecae8f24'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.042841 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcffbc9b54344ed83f3e0efecae8f24'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.043556 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcffbc9b54344ed83f3e0efecae8f24'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.055255 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcffbc9b54344ed83f3e0efecae8f24'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.070807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1446/2851] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:06 2022] DELETE /identity/v3/users/cfcffbc9b54344ed83f3e0efecae8f24 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:07.075920 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb674-79de-4e1a-987a-18346fd0144c None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:07.076475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb674-79de-4e1a-987a-18346fd0144c None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:07.076475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb674-79de-4e1a-987a-18346fd0144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:07.097685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0f3fb674-79de-4e1a-987a-18346fd0144c None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:07.099026 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0f3fb674-79de-4e1a-987a-18346fd0144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:07.165402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1406/2852] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:07.176713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:07.178211 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:07.243462 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438afb-bf1b-481e-b4b8-177cd0486a15 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:07.247427 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb086-a27c-44c6-9a4c-c56c80235b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:07.248067 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb086-a27c-44c6-9a4c-c56c80235b1b service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:07.248350 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb086-a27c-44c6-9a4c-c56c80235b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:07.248624 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb086-a27c-44c6-9a4c-c56c80235b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:07.259557 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb086-a27c-44c6-9a4c-c56c80235b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:07.261022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb086-a27c-44c6-9a4c-c56c80235b1b service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:07.274016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1447/2853] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:07.594046 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb674-79de-4e1a-987a-18346fd0144c None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:07.595841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0f3fb674-79de-4e1a-987a-18346fd0144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:07.614575 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb674-79de-4e1a-987a-18346fd0144c None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:07.621435 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:07.622222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:07.622651 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:07.623101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] PATH_INFO: `/v3/projects/cdf6f341c5864f17871f30255749f38c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:07.624944 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf6f341c5864f17871f30255749f38c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:07.628960 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:07.681286 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:07.692483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf6f341c5864f17871f30255749f38c', 'request_id': 'req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.702672 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf6f341c5864f17871f30255749f38c', 'request_id': 'req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.714410 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf6f341c5864f17871f30255749f38c', 'request_id': 'req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.729385 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] The token cache is being invalidate because project cdf6f341c5864f17871f30255749f38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:07.729698 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.730360 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.731940 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1407/2854] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:07 2022] DELETE /identity/v3/projects/cdf6f341c5864f17871f30255749f38c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:07.736534 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb086-a27c-44c6-9a4c-c56c80235b1b service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:07.747263 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb086-a27c-44c6-9a4c-c56c80235b1b service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:07.817971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:07.818665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:07.818954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:07.819231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] PATH_INFO: `/v3/users/7ca531fd8db748d58d59ca386f4a7133` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:07.820453 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca531fd8db748d58d59ca386f4a7133)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:07.822670 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:07.877537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca531fd8db748d58d59ca386f4a7133'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.890052 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:07.892907 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca531fd8db748d58d59ca386f4a7133'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.893799 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca531fd8db748d58d59ca386f4a7133'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.895228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca531fd8db748d58d59ca386f4a7133'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.905552 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-956e612a-45cd-44e9-b3fa-9171d4a8186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca531fd8db748d58d59ca386f4a7133'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:07.921632 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1448/2855] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:07 2022] DELETE /identity/v3/users/7ca531fd8db748d58d59ca386f4a7133 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:55:08.274203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:08.277288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:08.300483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8102-e3cc-4da1-8ffb-dc3f46b2d351 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:08.392937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:08.393547 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:08.393802 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:08.394059 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] PATH_INFO: `/v3/projects/e43b653742df42679896e7b16c1a32d3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:08.395460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43b653742df42679896e7b16c1a32d3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:08.397471 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:08.472019 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43b653742df42679896e7b16c1a32d3', 'request_id': 'req-9fabc741-0924-4831-8f83-9dcd93ad606b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:08.484253 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43b653742df42679896e7b16c1a32d3', 'request_id': 'req-9fabc741-0924-4831-8f83-9dcd93ad606b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:08.499483 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43b653742df42679896e7b16c1a32d3', 'request_id': 'req-9fabc741-0924-4831-8f83-9dcd93ad606b'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:08.514103 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] The token cache is being invalidate because project e43b653742df42679896e7b16c1a32d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:08.514405 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:08.515141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-9fabc741-0924-4831-8f83-9dcd93ad606b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:08.516786 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1408/2856] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:08 2022] DELETE /identity/v3/projects/e43b653742df42679896e7b16c1a32d3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:08.524002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f2f5-9138-407f-ba9d-96646ca94032 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:08.524443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f2f5-9138-407f-ba9d-96646ca94032 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:08.524946 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f2f5-9138-407f-ba9d-96646ca94032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:08.548343 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-fab8f2f5-9138-407f-ba9d-96646ca94032 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:08.549627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-fab8f2f5-9138-407f-ba9d-96646ca94032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:08.627492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1449/2857] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:08.637641 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bd6c5-7c52-42d9-9cef-3c1fcef4eaee None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:08.638075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bd6c5-7c52-42d9-9cef-3c1fcef4eaee None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:08.638485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bd6c5-7c52-42d9-9cef-3c1fcef4eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:08.662711 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-9f3bd6c5-7c52-42d9-9cef-3c1fcef4eaee None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:08.663857 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-9f3bd6c5-7c52-42d9-9cef-3c1fcef4eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:08.674008 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1409/2858] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:08.678765 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8f2f5-9138-407f-ba9d-96646ca94032 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:08.690620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8f2f5-9138-407f-ba9d-96646ca94032 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:08.695947 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:08.696604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:08.697537 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:08.697822 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:08.698527 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:55:08.698837 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:08.700464 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:08.714201 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1450/2859] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:55:08.719650 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bd6c5-7c52-42d9-9cef-3c1fcef4eaee None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:08.734256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bd6c5-7c52-42d9-9cef-3c1fcef4eaee None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:08.740092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269197f0-432d-47d3-8334-da07b8c0b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:08.740818 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269197f0-432d-47d3-8334-da07b8c0b169 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:08.741133 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269197f0-432d-47d3-8334-da07b8c0b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:08.741932 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269197f0-432d-47d3-8334-da07b8c0b169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:08.742163 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269197f0-432d-47d3-8334-da07b8c0b169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:08.745285 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269197f0-432d-47d3-8334-da07b8c0b169 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:08.779141 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1410/2860] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:08 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:08.783770 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:08.795687 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b33490-5057-4d60-9f28-81abf85582b3 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:08.873545 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4876-c6a1-4c30-9536-dc3edc43718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:08.874197 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4876-c6a1-4c30-9536-dc3edc43718a admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:08.874506 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4876-c6a1-4c30-9536-dc3edc43718a admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:08.874769 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4876-c6a1-4c30-9536-dc3edc43718a admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:08.875656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4876-c6a1-4c30-9536-dc3edc43718a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:08.877634 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4876-c6a1-4c30-9536-dc3edc43718a admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:08.903130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1451/2861] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:08 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:08.917821 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269197f0-432d-47d3-8334-da07b8c0b169 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:08.937813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269197f0-432d-47d3-8334-da07b8c0b169 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:08.944179 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d248-511d-43a2-9b98-980fa650f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:08.944901 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d248-511d-43a2-9b98-980fa650f0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:08.945290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d248-511d-43a2-9b98-980fa650f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:08.945756 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d248-511d-43a2-9b98-980fa650f0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:08.947018 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053d248-511d-43a2-9b98-980fa650f0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:08.950007 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053d248-511d-43a2-9b98-980fa650f0a1 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:08.963679 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1411/2862] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:08.972815 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4876-c6a1-4c30-9536-dc3edc43718a admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:08.984424 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4876-c6a1-4c30-9536-dc3edc43718a admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:08.990127 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a514219-98e6-43a1-97c1-2d81d85adf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:08.990784 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514219-98e6-43a1-97c1-2d81d85adf0c admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:08.991056 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514219-98e6-43a1-97c1-2d81d85adf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:08.991318 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a514219-98e6-43a1-97c1-2d81d85adf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:08.991956 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514219-98e6-43a1-97c1-2d81d85adf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:08.993665 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a514219-98e6-43a1-97c1-2d81d85adf0c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.004998 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1452/2863] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:09.010634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d248-511d-43a2-9b98-980fa650f0a1 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:09.021994 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d248-511d-43a2-9b98-980fa650f0a1 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:09.029031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94f23-d628-4135-81f7-2acfd26b7f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:09.029031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94f23-d628-4135-81f7-2acfd26b7f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.029031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94f23-d628-4135-81f7-2acfd26b7f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.029031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94f23-d628-4135-81f7-2acfd26b7f1e admin admin] PATH_INFO: `/v3/projects/4267281fdde841658998f081d620586f/users/39421dc7730f4b7995559c37f4e4b04f/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.047303 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94f23-d628-4135-81f7-2acfd26b7f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4267281fdde841658998f081d620586f, user_id=39421dc7730f4b7995559c37f4e4b04f, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:09.050031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b94f23-d628-4135-81f7-2acfd26b7f1e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.052949 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:09.069814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1412/2864] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:09 2022] PUT /identity/v3/projects/4267281fdde841658998f081d620586f/users/39421dc7730f4b7995559c37f4e4b04f/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:09.082606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cef93-06f1-451e-bf18-1cfe0e377c34 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.082887 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cef93-06f1-451e-bf18-1cfe0e377c34 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.083165 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cef93-06f1-451e-bf18-1cfe0e377c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.116674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-177cef93-06f1-451e-bf18-1cfe0e377c34 None None] MFA Rules not processed for user `39421dc7730f4b7995559c37f4e4b04f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:09.117975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-177cef93-06f1-451e-bf18-1cfe0e377c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:09.164806 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:09.209861 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1453/2865] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:09.216769 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94f23-d628-4135-81f7-2acfd26b7f1e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:09.299252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94f23-d628-4135-81f7-2acfd26b7f1e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:09.304779 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b999-ab5c-449d-bcae-664085df4eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:09.306117 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b999-ab5c-449d-bcae-664085df4eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.306412 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b999-ab5c-449d-bcae-664085df4eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.306699 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b999-ab5c-449d-bcae-664085df4eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.307946 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4b999-ab5c-449d-bcae-664085df4eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:09.309972 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4b999-ab5c-449d-bcae-664085df4eb7 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.344390 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1413/2866] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:09 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:09.350546 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cef93-06f1-451e-bf18-1cfe0e377c34 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:09.364259 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cef93-06f1-451e-bf18-1cfe0e377c34 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:09.430959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87459fe2-bd3a-495a-84fd-f4035b9c1667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:09.431629 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87459fe2-bd3a-495a-84fd-f4035b9c1667 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.431908 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87459fe2-bd3a-495a-84fd-f4035b9c1667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.432213 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87459fe2-bd3a-495a-84fd-f4035b9c1667 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.432912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87459fe2-bd3a-495a-84fd-f4035b9c1667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:09.434974 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87459fe2-bd3a-495a-84fd-f4035b9c1667 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.459958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1454/2867] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:09 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:09.465451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b999-ab5c-449d-bcae-664085df4eb7 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:09.476824 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b999-ab5c-449d-bcae-664085df4eb7 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:09.483092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27b339-4d42-404a-97b0-aceadb9e7d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:09.483757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b339-4d42-404a-97b0-aceadb9e7d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.484039 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b339-4d42-404a-97b0-aceadb9e7d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.484315 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27b339-4d42-404a-97b0-aceadb9e7d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.485015 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27b339-4d42-404a-97b0-aceadb9e7d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:09.486681 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27b339-4d42-404a-97b0-aceadb9e7d5e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.499274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1414/2868] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:09.504237 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87459fe2-bd3a-495a-84fd-f4035b9c1667 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:09.519402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87459fe2-bd3a-495a-84fd-f4035b9c1667 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:09.524206 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f47da-5371-4efe-aa35-42f9a5c02ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:09.525345 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f47da-5371-4efe-aa35-42f9a5c02ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.525789 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f47da-5371-4efe-aa35-42f9a5c02ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.526074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f47da-5371-4efe-aa35-42f9a5c02ff4 admin admin] PATH_INFO: `/v3/projects/6b81aa1e5f7249c1828de37b58d5b1fc/users/f83ca23ef5f84877adcb5430e72631f6/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.546030 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f47da-5371-4efe-aa35-42f9a5c02ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b81aa1e5f7249c1828de37b58d5b1fc, user_id=f83ca23ef5f84877adcb5430e72631f6, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:09.548787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f47da-5371-4efe-aa35-42f9a5c02ff4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.563048 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1455/2869] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:09 2022] PUT /identity/v3/projects/6b81aa1e5f7249c1828de37b58d5b1fc/users/f83ca23ef5f84877adcb5430e72631f6/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:09.567343 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27b339-4d42-404a-97b0-aceadb9e7d5e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:09.578223 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27b339-4d42-404a-97b0-aceadb9e7d5e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:09.640913 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bf670-b970-4899-91fc-7f832020eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:09.641640 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf670-b970-4899-91fc-7f832020eb74 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.641959 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf670-b970-4899-91fc-7f832020eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.642234 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf670-b970-4899-91fc-7f832020eb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.642958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bf670-b970-4899-91fc-7f832020eb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:09.644836 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bf670-b970-4899-91fc-7f832020eb74 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.655719 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1415/2870] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:09.660108 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f47da-5371-4efe-aa35-42f9a5c02ff4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:09.672468 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f47da-5371-4efe-aa35-42f9a5c02ff4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:09.677502 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:09.678185 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.678492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.678772 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] PATH_INFO: `/v3/projects/6b81aa1e5f7249c1828de37b58d5b1fc/users/f83ca23ef5f84877adcb5430e72631f6/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.680767 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b81aa1e5f7249c1828de37b58d5b1fc, user_id=f83ca23ef5f84877adcb5430e72631f6, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:09.683580 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.695465 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1456/2871] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:09 2022] PUT /identity/v3/projects/6b81aa1e5f7249c1828de37b58d5b1fc/users/f83ca23ef5f84877adcb5430e72631f6/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:09.707845 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df484b7-f8fd-4925-aa29-7dc49f6f5dc5 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.708275 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df484b7-f8fd-4925-aa29-7dc49f6f5dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.708655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df484b7-f8fd-4925-aa29-7dc49f6f5dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.739318 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-4df484b7-f8fd-4925-aa29-7dc49f6f5dc5 None None] MFA Rules not processed for user `f83ca23ef5f84877adcb5430e72631f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:09.740449 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-4df484b7-f8fd-4925-aa29-7dc49f6f5dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:09.796344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:09.817357 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1416/2872] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:09.833228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:09.835058 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:09.899245 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8f14b-8af5-4d0f-a9d4-e527c38c4476 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:09.905023 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f1018-fe85-42f5-9358-9d07ef887339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:09.905970 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f1018-fe85-42f5-9358-9d07ef887339 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:09.906444 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f1018-fe85-42f5-9358-9d07ef887339 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:09.906843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f1018-fe85-42f5-9358-9d07ef887339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:09.922803 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f1018-fe85-42f5-9358-9d07ef887339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:09.925395 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f1018-fe85-42f5-9358-9d07ef887339 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:09.941429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1457/2873] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:55:10.422460 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df484b7-f8fd-4925-aa29-7dc49f6f5dc5 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:10.494922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df484b7-f8fd-4925-aa29-7dc49f6f5dc5 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:10.500127 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:10.500810 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:10.501097 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:10.501378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] PATH_INFO: `/v3/users/39421dc7730f4b7995559c37f4e4b04f` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:10.502685 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39421dc7730f4b7995559c37f4e4b04f)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:10.504770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:10.558165 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39421dc7730f4b7995559c37f4e4b04f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:10.570954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39421dc7730f4b7995559c37f4e4b04f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:10.579508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39421dc7730f4b7995559c37f4e4b04f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:10.580252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39421dc7730f4b7995559c37f4e4b04f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:10.580846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39421dc7730f4b7995559c37f4e4b04f'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:10.594911 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1417/2874] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:10 2022] DELETE /identity/v3/users/39421dc7730f4b7995559c37f4e4b04f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:10.599944 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cb6a-8a2a-4641-a9b4-4a8760a8783e None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:10.600224 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cb6a-8a2a-4641-a9b4-4a8760a8783e None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:10.600495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cb6a-8a2a-4641-a9b4-4a8760a8783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:10.621714 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-2602cb6a-8a2a-4641-a9b4-4a8760a8783e None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:10.622973 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2602cb6a-8a2a-4641-a9b4-4a8760a8783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:10.654674 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:10.698447 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1458/2875] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:10.710118 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:10.711804 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:10.778086 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec678516-0edc-4334-93e8-1f0232501321 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:10.781931 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccee2da-ca4a-42a6-90fd-a474d24bb0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:10.782586 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee2da-ca4a-42a6-90fd-a474d24bb0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:10.782865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee2da-ca4a-42a6-90fd-a474d24bb0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:10.783131 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee2da-ca4a-42a6-90fd-a474d24bb0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:10.793819 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccee2da-ca4a-42a6-90fd-a474d24bb0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:10.795348 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccee2da-ca4a-42a6-90fd-a474d24bb0a8 service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:10.806706 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1418/2876] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:11.117829 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602cb6a-8a2a-4641-a9b4-4a8760a8783e None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:11.119550 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-2602cb6a-8a2a-4641-a9b4-4a8760a8783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:11.133076 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602cb6a-8a2a-4641-a9b4-4a8760a8783e None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:11.139429 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:11.140250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:11.140535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:11.140787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] PATH_INFO: `/v3/projects/4267281fdde841658998f081d620586f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:11.142005 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4267281fdde841658998f081d620586f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:11.143992 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:11.206221 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4267281fdde841658998f081d620586f', 'request_id': 'req-997f8574-c734-45bd-8973-5501a986796d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.212728 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4267281fdde841658998f081d620586f', 'request_id': 'req-997f8574-c734-45bd-8973-5501a986796d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.218778 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4267281fdde841658998f081d620586f', 'request_id': 'req-997f8574-c734-45bd-8973-5501a986796d'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.233922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] The token cache is being invalidate because project 4267281fdde841658998f081d620586f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:11.234235 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.234931 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.236505 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1459/2877] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:11 2022] DELETE /identity/v3/projects/4267281fdde841658998f081d620586f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:11.241899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccee2da-ca4a-42a6-90fd-a474d24bb0a8 service neutron] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:11.252045 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccee2da-ca4a-42a6-90fd-a474d24bb0a8 service neutron] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:11.263549 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:11.337431 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:11.338413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:11.338863 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:11.339280 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] PATH_INFO: `/v3/users/f83ca23ef5f84877adcb5430e72631f6` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:11.341383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83ca23ef5f84877adcb5430e72631f6)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:11.345217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:11.408464 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83ca23ef5f84877adcb5430e72631f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.423126 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83ca23ef5f84877adcb5430e72631f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.430115 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83ca23ef5f84877adcb5430e72631f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.430993 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83ca23ef5f84877adcb5430e72631f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.431796 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-e17a77bb-80f4-421f-a90f-3536bb77a79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83ca23ef5f84877adcb5430e72631f6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.447688 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1419/2878] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:11 2022] DELETE /identity/v3/users/f83ca23ef5f84877adcb5430e72631f6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:11.779131 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:11.780912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:11.806926 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8574-c734-45bd-8973-5501a986796d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:11.871843 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:11.872514 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:11.872792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:11.873062 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] PATH_INFO: `/v3/projects/6b81aa1e5f7249c1828de37b58d5b1fc` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:11.874337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b81aa1e5f7249c1828de37b58d5b1fc)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:11.876330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:11.932156 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b81aa1e5f7249c1828de37b58d5b1fc', 'request_id': 'req-b9f9faa8-49db-406f-9f9b-0d8313f796ac'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.938980 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b81aa1e5f7249c1828de37b58d5b1fc', 'request_id': 'req-b9f9faa8-49db-406f-9f9b-0d8313f796ac'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.940252 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:11.946027 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b81aa1e5f7249c1828de37b58d5b1fc', 'request_id': 'req-b9f9faa8-49db-406f-9f9b-0d8313f796ac'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.964622 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] The token cache is being invalidate because project 6b81aa1e5f7249c1828de37b58d5b1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:11.965089 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.965983 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-b9f9faa8-49db-406f-9f9b-0d8313f796ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:11.968473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1460/2879] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:11 2022] DELETE /identity/v3/projects/6b81aa1e5f7249c1828de37b58d5b1fc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 14:55:11.975648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd05a1c-d920-4f2a-a468-775acb7c2719 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:11.975937 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd05a1c-d920-4f2a-a468-775acb7c2719 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:11.976228 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd05a1c-d920-4f2a-a468-775acb7c2719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.007832 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0cd05a1c-d920-4f2a-a468-775acb7c2719 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:12.009709 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0cd05a1c-d920-4f2a-a468-775acb7c2719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:12.084218 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1420/2880] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:12.154454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f99ce-e9b6-487d-b488-d1bfd5058607 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.155066 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f99ce-e9b6-487d-b488-d1bfd5058607 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.155232 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f99ce-e9b6-487d-b488-d1bfd5058607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.185404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-b85f99ce-e9b6-487d-b488-d1bfd5058607 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:12.187270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-b85f99ce-e9b6-487d-b488-d1bfd5058607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:12.199724 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1461/2881] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:12.204237 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd05a1c-d920-4f2a-a468-775acb7c2719 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:12.214795 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd05a1c-d920-4f2a-a468-775acb7c2719 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:12.219871 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:12.220513 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.220734 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.221004 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.221676 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:55:12.221969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:12.223648 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:12.240656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1421/2882] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:55:12.245995 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f99ce-e9b6-487d-b488-d1bfd5058607 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:12.255805 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f99ce-e9b6-487d-b488-d1bfd5058607 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:12.261495 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180e353-0ada-4b28-9548-78cdc0fcec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:12.262122 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180e353-0ada-4b28-9548-78cdc0fcec23 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.262476 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180e353-0ada-4b28-9548-78cdc0fcec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.262713 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180e353-0ada-4b28-9548-78cdc0fcec23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.263351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180e353-0ada-4b28-9548-78cdc0fcec23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:12.265287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180e353-0ada-4b28-9548-78cdc0fcec23 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:12.296644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1462/2883] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:12 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:12.301170 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:12.311689 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5043-5fcb-4f31-82f3-2a2d2ebe9c23 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:12.329239 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:12.388569 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ce4c-198f-49dc-a2db-5dba8618a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:12.389184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ce4c-198f-49dc-a2db-5dba8618a2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.389459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ce4c-198f-49dc-a2db-5dba8618a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.389724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ce4c-198f-49dc-a2db-5dba8618a2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.390365 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ce4c-198f-49dc-a2db-5dba8618a2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:12.392321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ce4c-198f-49dc-a2db-5dba8618a2a8 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:12.415536 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1422/2884] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:12 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:12.419792 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180e353-0ada-4b28-9548-78cdc0fcec23 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:12.431168 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180e353-0ada-4b28-9548-78cdc0fcec23 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:12.436647 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94010-c986-44be-8647-9ccc4fde3bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:12.437278 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94010-c986-44be-8647-9ccc4fde3bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.437553 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94010-c986-44be-8647-9ccc4fde3bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.437846 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c94010-c986-44be-8647-9ccc4fde3bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.438535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c94010-c986-44be-8647-9ccc4fde3bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:12.440164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c94010-c986-44be-8647-9ccc4fde3bd7 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:12.451977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1463/2885] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:12.458539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ce4c-198f-49dc-a2db-5dba8618a2a8 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:12.474074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ce4c-198f-49dc-a2db-5dba8618a2a8 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:12.481156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfb50b-096f-4846-8f1d-c0d198fa13b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:12.481156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfb50b-096f-4846-8f1d-c0d198fa13b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.481156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfb50b-096f-4846-8f1d-c0d198fa13b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.481156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfb50b-096f-4846-8f1d-c0d198fa13b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.483333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfb50b-096f-4846-8f1d-c0d198fa13b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:12.483333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfb50b-096f-4846-8f1d-c0d198fa13b4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:12.494659 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1423/2886] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:12.499144 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94010-c986-44be-8647-9ccc4fde3bd7 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:12.511564 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c94010-c986-44be-8647-9ccc4fde3bd7 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:12.516645 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:12.517328 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.517606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.517877 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] PATH_INFO: `/v3/projects/00a9c6c037a54a428e99c31f6c95464c/users/1deeafa3df3641418c5e56843f9f385c/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.535602 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a9c6c037a54a428e99c31f6c95464c, user_id=1deeafa3df3641418c5e56843f9f385c, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:12.538300 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:12.554625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1464/2887] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:12 2022] PUT /identity/v3/projects/00a9c6c037a54a428e99c31f6c95464c/users/1deeafa3df3641418c5e56843f9f385c/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:12.565199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe858ca-f90c-4deb-8aac-ac55b8c2955f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.565481 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe858ca-f90c-4deb-8aac-ac55b8c2955f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.565752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe858ca-f90c-4deb-8aac-ac55b8c2955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.746199 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-cbe858ca-f90c-4deb-8aac-ac55b8c2955f None None] MFA Rules not processed for user `1deeafa3df3641418c5e56843f9f385c`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:12.747400 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-cbe858ca-f90c-4deb-8aac-ac55b8c2955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:12.822409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1424/2888] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:12.834748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:12.836849 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:12.904891 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c70af9-2da5-45d7-867c-a30ee6b2b7ec admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:12.908999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a6ee7-3b06-4725-a8d0-fb291ce8b55f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:12.909630 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6ee7-3b06-4725-a8d0-fb291ce8b55f service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:12.909912 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6ee7-3b06-4725-a8d0-fb291ce8b55f service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:12.910183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6ee7-3b06-4725-a8d0-fb291ce8b55f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:12.920415 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a6ee7-3b06-4725-a8d0-fb291ce8b55f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:12.921900 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a6ee7-3b06-4725-a8d0-fb291ce8b55f service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:12.932352 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1465/2889] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:22.818528 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:22.927658 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:DELETE=3,keystone:SELECT=57,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:25.069035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe858ca-f90c-4deb-8aac-ac55b8c2955f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:25.146619 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe858ca-f90c-4deb-8aac-ac55b8c2955f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:25.152274 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:25.152957 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:25.153359 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:25.153687 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] PATH_INFO: `/v3/users/1deeafa3df3641418c5e56843f9f385c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:25.154899 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1deeafa3df3641418c5e56843f9f385c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:25.156861 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:25.224027 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1deeafa3df3641418c5e56843f9f385c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.239180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1deeafa3df3641418c5e56843f9f385c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.247800 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1deeafa3df3641418c5e56843f9f385c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.248571 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1deeafa3df3641418c5e56843f9f385c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.249174 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1deeafa3df3641418c5e56843f9f385c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.268574 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1425/2890] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:25 2022] DELETE /identity/v3/users/1deeafa3df3641418c5e56843f9f385c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:25.273610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c41c-2f16-4688-9a8c-6bf7080b47d4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:25.274524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c41c-2f16-4688-9a8c-6bf7080b47d4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:25.274524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c41c-2f16-4688-9a8c-6bf7080b47d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:25.302026 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-acd6c41c-2f16-4688-9a8c-6bf7080b47d4 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:25.303991 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-acd6c41c-2f16-4688-9a8c-6bf7080b47d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:25.391588 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1466/2891] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:25.403040 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:25.404770 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:25.479552 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb2827-af89-4472-b556-6e804990a1d4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:25.483451 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fdba2-3007-4e3c-94e5-a7a32966c12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:25.484092 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fdba2-3007-4e3c-94e5-a7a32966c12f service neutron] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:25.484370 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fdba2-3007-4e3c-94e5-a7a32966c12f service neutron] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:25.484642 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fdba2-3007-4e3c-94e5-a7a32966c12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:25.496408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fdba2-3007-4e3c-94e5-a7a32966c12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:25.499112 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fdba2-3007-4e3c-94e5-a7a32966c12f service neutron] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:25.518197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1426/2892] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:55:25.835231 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c41c-2f16-4688-9a8c-6bf7080b47d4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:25.837043 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-acd6c41c-2f16-4688-9a8c-6bf7080b47d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:25.853996 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c41c-2f16-4688-9a8c-6bf7080b47d4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:25.863943 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:25.865049 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:25.865548 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:25.866029 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] PATH_INFO: `/v3/projects/00a9c6c037a54a428e99c31f6c95464c` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:25.869531 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a9c6c037a54a428e99c31f6c95464c)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:25.873853 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:25.945936 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a9c6c037a54a428e99c31f6c95464c', 'request_id': 'req-ac673f82-57de-4cdb-a620-2cf5106ffe83'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.954065 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a9c6c037a54a428e99c31f6c95464c', 'request_id': 'req-ac673f82-57de-4cdb-a620-2cf5106ffe83'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.961322 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a9c6c037a54a428e99c31f6c95464c', 'request_id': 'req-ac673f82-57de-4cdb-a620-2cf5106ffe83'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.976955 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] The token cache is being invalidate because project 00a9c6c037a54a428e99c31f6c95464c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81722) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:25.977360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.978848 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-ac673f82-57de-4cdb-a620-2cf5106ffe83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:25.980721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1467/2893] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:25 2022] DELETE /identity/v3/projects/00a9c6c037a54a428e99c31f6c95464c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:25.986520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d479e0d-088c-4893-8802-0ed2c83a220f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:25.986872 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d479e0d-088c-4893-8802-0ed2c83a220f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:25.987188 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d479e0d-088c-4893-8802-0ed2c83a220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.010182 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-2d479e0d-088c-4893-8802-0ed2c83a220f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:26.012284 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-2d479e0d-088c-4893-8802-0ed2c83a220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:26.042256 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:26.097236 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1427/2894] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:26.107481 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaea8a-4717-498d-b547-c1cd08211d4a None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.107903 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaea8a-4717-498d-b547-c1cd08211d4a None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.108302 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaea8a-4717-498d-b547-c1cd08211d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.132782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9fbaea8a-4717-498d-b547-c1cd08211d4a None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:26.134180 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9fbaea8a-4717-498d-b547-c1cd08211d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:26.143775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1468/2895] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:26.148749 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d479e0d-088c-4893-8802-0ed2c83a220f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.163226 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d479e0d-088c-4893-8802-0ed2c83a220f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.171963 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.172942 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.173413 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.173833 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.174644 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81723) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:55:26.175147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.178031 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.201633 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1428/2896] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:55:26.206971 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaea8a-4717-498d-b547-c1cd08211d4a None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.219679 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaea8a-4717-498d-b547-c1cd08211d4a None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.225940 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4c204-42d3-4e3f-9df7-dfc7335de7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.226615 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4c204-42d3-4e3f-9df7-dfc7335de7ab admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.226890 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4c204-42d3-4e3f-9df7-dfc7335de7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.227145 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4c204-42d3-4e3f-9df7-dfc7335de7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.228072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4c204-42d3-4e3f-9df7-dfc7335de7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.230351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4c204-42d3-4e3f-9df7-dfc7335de7ab admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.263402 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1469/2897] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:26 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:26.269408 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.280056 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc2f9-b5e0-4adf-a532-e9ebe8902f53 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.354582 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c289-3d6b-4b8a-978a-cbf15cda23b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.355203 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c289-3d6b-4b8a-978a-cbf15cda23b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.355499 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c289-3d6b-4b8a-978a-cbf15cda23b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.355764 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c289-3d6b-4b8a-978a-cbf15cda23b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.356418 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26c289-3d6b-4b8a-978a-cbf15cda23b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.358456 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26c289-3d6b-4b8a-978a-cbf15cda23b0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.386920 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1429/2898] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:26 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:26.391535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4c204-42d3-4e3f-9df7-dfc7335de7ab admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.402851 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4c204-42d3-4e3f-9df7-dfc7335de7ab admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.408260 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b0087-d0d3-44d3-9319-57c95652425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.408930 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0087-d0d3-44d3-9319-57c95652425d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.409204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0087-d0d3-44d3-9319-57c95652425d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.409473 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0087-d0d3-44d3-9319-57c95652425d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.410160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b0087-d0d3-44d3-9319-57c95652425d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.412433 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b0087-d0d3-44d3-9319-57c95652425d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.425894 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1470/2899] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:26.431726 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c289-3d6b-4b8a-978a-cbf15cda23b0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.448294 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26c289-3d6b-4b8a-978a-cbf15cda23b0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.454162 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b36e5-8b59-4467-92d4-e040b8ac48c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.454732 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b36e5-8b59-4467-92d4-e040b8ac48c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.455005 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b36e5-8b59-4467-92d4-e040b8ac48c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.455403 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b36e5-8b59-4467-92d4-e040b8ac48c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.456098 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b36e5-8b59-4467-92d4-e040b8ac48c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.458087 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b36e5-8b59-4467-92d4-e040b8ac48c0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.470153 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1430/2900] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:26.474709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b0087-d0d3-44d3-9319-57c95652425d admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.485628 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b0087-d0d3-44d3-9319-57c95652425d admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.491057 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f087511-ac53-47e1-a5c6-4326a44fdb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.491737 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087511-ac53-47e1-a5c6-4326a44fdb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.492038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087511-ac53-47e1-a5c6-4326a44fdb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.492303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087511-ac53-47e1-a5c6-4326a44fdb17 admin admin] PATH_INFO: `/v3/projects/fb38cd07cec74224afce99bb14d537d7/users/dcabef7262a24883a86132107f907a1f/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.517742 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f087511-ac53-47e1-a5c6-4326a44fdb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb38cd07cec74224afce99bb14d537d7, user_id=dcabef7262a24883a86132107f907a1f, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.522606 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f087511-ac53-47e1-a5c6-4326a44fdb17 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.540825 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1471/2901] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:26 2022] PUT /identity/v3/projects/fb38cd07cec74224afce99bb14d537d7/users/dcabef7262a24883a86132107f907a1f/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:26.551813 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8bf3c-6b67-46a6-aeea-b62dcdff8337 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.552159 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8bf3c-6b67-46a6-aeea-b62dcdff8337 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.552458 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8bf3c-6b67-46a6-aeea-b62dcdff8337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.585229 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-0fe8bf3c-6b67-46a6-aeea-b62dcdff8337 None None] MFA Rules not processed for user `dcabef7262a24883a86132107f907a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:26.586661 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-0fe8bf3c-6b67-46a6-aeea-b62dcdff8337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:26.669745 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1431/2902] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:26.674342 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f087511-ac53-47e1-a5c6-4326a44fdb17 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.700717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:26.748467 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f087511-ac53-47e1-a5c6-4326a44fdb17 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.753416 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a62aea-1b5a-497e-a089-cc26b4d4fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.754046 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62aea-1b5a-497e-a089-cc26b4d4fcbc admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.754311 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62aea-1b5a-497e-a089-cc26b4d4fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.754627 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62aea-1b5a-497e-a089-cc26b4d4fcbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.755266 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a62aea-1b5a-497e-a089-cc26b4d4fcbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.757211 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a62aea-1b5a-497e-a089-cc26b4d4fcbc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.795957 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1472/2903] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:26 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:26.800487 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8bf3c-6b67-46a6-aeea-b62dcdff8337 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.812743 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8bf3c-6b67-46a6-aeea-b62dcdff8337 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.829222 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:26.885325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f633-c9ef-4909-90ae-fd2a4002a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.885971 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f633-c9ef-4909-90ae-fd2a4002a2cf admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.886244 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f633-c9ef-4909-90ae-fd2a4002a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.886556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f633-c9ef-4909-90ae-fd2a4002a2cf admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.887197 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739f633-c9ef-4909-90ae-fd2a4002a2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.889137 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739f633-c9ef-4909-90ae-fd2a4002a2cf admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.916682 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1432/2904] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:26 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:55:26.922039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a62aea-1b5a-497e-a089-cc26b4d4fcbc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.935414 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a62aea-1b5a-497e-a089-cc26b4d4fcbc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.941103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca5c1-8a8a-48ce-aaa7-4064218ba6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.941739 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca5c1-8a8a-48ce-aaa7-4064218ba6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.942016 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca5c1-8a8a-48ce-aaa7-4064218ba6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.942285 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca5c1-8a8a-48ce-aaa7-4064218ba6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.942975 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ca5c1-8a8a-48ce-aaa7-4064218ba6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.944637 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ca5c1-8a8a-48ce-aaa7-4064218ba6c0 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.958007 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1473/2905] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:26.962877 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f633-c9ef-4909-90ae-fd2a4002a2cf admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:26.974144 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f633-c9ef-4909-90ae-fd2a4002a2cf admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:26.979654 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7813f-ac3d-4cd2-9302-96b44a735e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:26.980296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7813f-ac3d-4cd2-9302-96b44a735e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:26.980566 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7813f-ac3d-4cd2-9302-96b44a735e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:26.981088 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7813f-ac3d-4cd2-9302-96b44a735e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:26.981766 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7813f-ac3d-4cd2-9302-96b44a735e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:26.983524 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7813f-ac3d-4cd2-9302-96b44a735e6b admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:26.996814 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1433/2906] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:27.009791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca5c1-8a8a-48ce-aaa7-4064218ba6c0 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:27.022814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca5c1-8a8a-48ce-aaa7-4064218ba6c0 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:27.029610 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac1419-4b33-4988-9d4a-ce79c5c54759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:27.030677 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1419-4b33-4988-9d4a-ce79c5c54759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.030959 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1419-4b33-4988-9d4a-ce79c5c54759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.031303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1419-4b33-4988-9d4a-ce79c5c54759 admin admin] PATH_INFO: `/v3/projects/8c3f7ba664b4490387323125b7b66e29/users/06f3413d2f6146dfb97579497fb890d8/roles/2284ec91b47444249d339c70801cd407` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.055292 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac1419-4b33-4988-9d4a-ce79c5c54759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3f7ba664b4490387323125b7b66e29, user_id=06f3413d2f6146dfb97579497fb890d8, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:27.058501 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac1419-4b33-4988-9d4a-ce79c5c54759 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:27.077941 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1474/2907] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:27 2022] PUT /identity/v3/projects/8c3f7ba664b4490387323125b7b66e29/users/06f3413d2f6146dfb97579497fb890d8/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:27.089865 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925d112-1379-4c8a-988e-dc44293e3dbc None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.090262 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925d112-1379-4c8a-988e-dc44293e3dbc None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.090747 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925d112-1379-4c8a-988e-dc44293e3dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.121817 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-6925d112-1379-4c8a-988e-dc44293e3dbc None None] MFA Rules not processed for user `06f3413d2f6146dfb97579497fb890d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:27.123251 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6925d112-1379-4c8a-988e-dc44293e3dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:27.213263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1434/2908] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:27.218999 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac1419-4b33-4988-9d4a-ce79c5c54759 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:27.299319 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac1419-4b33-4988-9d4a-ce79c5c54759 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:27.307535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a45dd-6a39-4988-98cb-0f15215e3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:27.308595 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a45dd-6a39-4988-98cb-0f15215e3ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.309072 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a45dd-6a39-4988-98cb-0f15215e3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.309551 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a45dd-6a39-4988-98cb-0f15215e3ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.310768 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a45dd-6a39-4988-98cb-0f15215e3ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:27.314419 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a45dd-6a39-4988-98cb-0f15215e3ca4 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:27.360755 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1475/2909] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:27 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:27.367142 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925d112-1379-4c8a-988e-dc44293e3dbc None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:27.380300 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925d112-1379-4c8a-988e-dc44293e3dbc None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:27.463585 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd16122-0f94-4681-ad03-673989e1fac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:27.464214 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd16122-0f94-4681-ad03-673989e1fac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.464477 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd16122-0f94-4681-ad03-673989e1fac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.464757 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd16122-0f94-4681-ad03-673989e1fac4 admin admin] PATH_INFO: `/v3/users` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.465404 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd16122-0f94-4681-ad03-673989e1fac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:27.467446 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd16122-0f94-4681-ad03-673989e1fac4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:27.495320 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1435/2910] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:27 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 14:55:27.500704 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a45dd-6a39-4988-98cb-0f15215e3ca4 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:27.516183 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a45dd-6a39-4988-98cb-0f15215e3ca4 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:27.521270 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7f89c-0103-4aca-ad6e-cd04abe03c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:27.522009 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f89c-0103-4aca-ad6e-cd04abe03c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.522337 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f89c-0103-4aca-ad6e-cd04abe03c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.522716 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f89c-0103-4aca-ad6e-cd04abe03c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.523397 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7f89c-0103-4aca-ad6e-cd04abe03c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:27.525272 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7f89c-0103-4aca-ad6e-cd04abe03c23 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:27.537962 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1476/2911] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:27.543156 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd16122-0f94-4681-ad03-673989e1fac4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:27.554492 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd16122-0f94-4681-ad03-673989e1fac4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:27.560134 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa3c7-2dc8-4f36-90ac-a0780999773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:27.560839 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa3c7-2dc8-4f36-90ac-a0780999773e admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.561121 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa3c7-2dc8-4f36-90ac-a0780999773e admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.561395 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfa3c7-2dc8-4f36-90ac-a0780999773e admin admin] PATH_INFO: `/v3/projects/d4c5d1cc96684faa89c827459fda64c3/users/d95712996adf447e9c9dc5a9c5d1c587/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.575969 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:27.579551 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa3c7-2dc8-4f36-90ac-a0780999773e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c5d1cc96684faa89c827459fda64c3, user_id=d95712996adf447e9c9dc5a9c5d1c587, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:27.582557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfa3c7-2dc8-4f36-90ac-a0780999773e admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:27.605508 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1436/2912] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:27 2022] PUT /identity/v3/projects/d4c5d1cc96684faa89c827459fda64c3/users/d95712996adf447e9c9dc5a9c5d1c587/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:27.612282 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7f89c-0103-4aca-ad6e-cd04abe03c23 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:27.629492 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7f89c-0103-4aca-ad6e-cd04abe03c23 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:27.691620 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:27.712883 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20da316-9615-4a1c-bf3d-27c97c139f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:27.713582 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20da316-9615-4a1c-bf3d-27c97c139f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.713922 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20da316-9615-4a1c-bf3d-27c97c139f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.714239 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20da316-9615-4a1c-bf3d-27c97c139f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.714979 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20da316-9615-4a1c-bf3d-27c97c139f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:27.716785 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20da316-9615-4a1c-bf3d-27c97c139f4d admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:27.729314 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1477/2913] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:27.735485 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa3c7-2dc8-4f36-90ac-a0780999773e admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:27.746801 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfa3c7-2dc8-4f36-90ac-a0780999773e admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:27.751916 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:27.752614 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.752891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.753157 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] PATH_INFO: `/v3/projects/d4c5d1cc96684faa89c827459fda64c3/users/d95712996adf447e9c9dc5a9c5d1c587/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.755217 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c5d1cc96684faa89c827459fda64c3, user_id=d95712996adf447e9c9dc5a9c5d1c587, role_id=c85d5bb8a0c040e1a702c4cd0e6c7e5d)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:27.758177 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:27.770558 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1437/2914] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:27 2022] PUT /identity/v3/projects/d4c5d1cc96684faa89c827459fda64c3/users/d95712996adf447e9c9dc5a9c5d1c587/roles/c85d5bb8a0c040e1a702c4cd0e6c7e5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:27.791360 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debea02-37b6-4444-a8c1-e4f4fe6986bb None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:27.791997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debea02-37b6-4444-a8c1-e4f4fe6986bb None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:27.791997 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debea02-37b6-4444-a8c1-e4f4fe6986bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:27.826797 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-9debea02-37b6-4444-a8c1-e4f4fe6986bb None None] MFA Rules not processed for user `d95712996adf447e9c9dc5a9c5d1c587`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:27.828069 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9debea02-37b6-4444-a8c1-e4f4fe6986bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:27.911172 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1478/2915] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:27.930071 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:27.932012 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:28.000334 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4ede5-629f-430f-824a-94b358abe0c4 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:28.004325 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb30b5-d353-4237-b28e-3fdb967db7e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:28.004954 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb30b5-d353-4237-b28e-3fdb967db7e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:28.005225 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb30b5-d353-4237-b28e-3fdb967db7e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:28.005488 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb30b5-d353-4237-b28e-3fdb967db7e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:28.073378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb30b5-d353-4237-b28e-3fdb967db7e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:28.074922 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb30b5-d353-4237-b28e-3fdb967db7e3 service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:28.088185 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1438/2916] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:29.683493 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debea02-37b6-4444-a8c1-e4f4fe6986bb None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:29.685130 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9debea02-37b6-4444-a8c1-e4f4fe6986bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:29.698160 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debea02-37b6-4444-a8c1-e4f4fe6986bb None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:29.702087 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b148-e739-43f0-b216-4525fc98bf43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:29.702758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b148-e739-43f0-b216-4525fc98bf43 service cinder] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:29.703035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b148-e739-43f0-b216-4525fc98bf43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:29.703302 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b148-e739-43f0-b216-4525fc98bf43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:29.780814 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7b148-e739-43f0-b216-4525fc98bf43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:29.783586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7b148-e739-43f0-b216-4525fc98bf43 service cinder] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:29.801863 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1479/2917] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:30.428902 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb30b5-d353-4237-b28e-3fdb967db7e3 service cinder] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:30.439500 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb30b5-d353-4237-b28e-3fdb967db7e3 service cinder] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:30.443658 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96ba16-9d43-40a6-802d-976bc42dd46d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:30.444288 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ba16-9d43-40a6-802d-976bc42dd46d service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:30.444561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ba16-9d43-40a6-802d-976bc42dd46d service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:30.444827 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ba16-9d43-40a6-802d-976bc42dd46d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:30.455883 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96ba16-9d43-40a6-802d-976bc42dd46d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:30.457383 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96ba16-9d43-40a6-802d-976bc42dd46d service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:30.468557 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1439/2918] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:34.472592 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b148-e739-43f0-b216-4525fc98bf43 service cinder] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:34.549123 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b148-e739-43f0-b216-4525fc98bf43 service cinder] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:34.554489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:34.555412 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:34.556265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:34.556265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] PATH_INFO: `/v3/users/dcabef7262a24883a86132107f907a1f` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:34.557586 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcabef7262a24883a86132107f907a1f)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:34.559746 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:34.565775 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=100 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:34.621549 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcabef7262a24883a86132107f907a1f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:34.636284 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcabef7262a24883a86132107f907a1f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:34.637094 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcabef7262a24883a86132107f907a1f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:34.637749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcabef7262a24883a86132107f907a1f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:34.647356 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcabef7262a24883a86132107f907a1f'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:34.662717 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1480/2919] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:34 2022] DELETE /identity/v3/users/dcabef7262a24883a86132107f907a1f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:34.668387 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4f27-550f-4f45-ac4a-fdc817ef8c7f None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:34.669263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4f27-550f-4f45-ac4a-fdc817ef8c7f None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:34.669263 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4f27-550f-4f45-ac4a-fdc817ef8c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:34.691951 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-c0be4f27-550f-4f45-ac4a-fdc817ef8c7f None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:34.693206 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c0be4f27-550f-4f45-ac4a-fdc817ef8c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:34.770302 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1440/2920] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 14:55:34.783489 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:34.785204 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:34.861566 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79499e-20dc-4fd4-bd20-947487c17e26 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:34.866540 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978eb07-8147-4195-af73-89e21a3faa7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:34.867393 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978eb07-8147-4195-af73-89e21a3faa7a service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:34.868106 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978eb07-8147-4195-af73-89e21a3faa7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:34.868491 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978eb07-8147-4195-af73-89e21a3faa7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:34.882709 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978eb07-8147-4195-af73-89e21a3faa7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:34.885443 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978eb07-8147-4195-af73-89e21a3faa7a service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:34.900945 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1481/2921] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 14:55:35.329888 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4f27-550f-4f45-ac4a-fdc817ef8c7f None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:35.332634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-c0be4f27-550f-4f45-ac4a-fdc817ef8c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:35.348667 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4f27-550f-4f45-ac4a-fdc817ef8c7f None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:35.354277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:35.354995 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:35.355287 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:35.355539 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] PATH_INFO: `/v3/projects/fb38cd07cec74224afce99bb14d537d7` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:35.356838 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb38cd07cec74224afce99bb14d537d7)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:35.358895 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:35.379038 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:35.420740 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb38cd07cec74224afce99bb14d537d7', 'request_id': 'req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.428541 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb38cd07cec74224afce99bb14d537d7', 'request_id': 'req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.440812 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb38cd07cec74224afce99bb14d537d7', 'request_id': 'req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.457106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] The token cache is being invalidate because project fb38cd07cec74224afce99bb14d537d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:35.457409 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.458106 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.459751 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1441/2922] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:35 2022] DELETE /identity/v3/projects/fb38cd07cec74224afce99bb14d537d7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:35.464332 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978eb07-8147-4195-af73-89e21a3faa7a service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:35.475361 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978eb07-8147-4195-af73-89e21a3faa7a service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:35.560831 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:35.561523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:35.561807 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:35.562103 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] PATH_INFO: `/v3/users/06f3413d2f6146dfb97579497fb890d8` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:35.563375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f3413d2f6146dfb97579497fb890d8)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:35.565375 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:35.599570 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:35.627921 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f3413d2f6146dfb97579497fb890d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.650577 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f3413d2f6146dfb97579497fb890d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.651689 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f3413d2f6146dfb97579497fb890d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.652661 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f3413d2f6146dfb97579497fb890d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.664749 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f3413d2f6146dfb97579497fb890d8'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:35.678988 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1482/2923] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:35 2022] DELETE /identity/v3/users/06f3413d2f6146dfb97579497fb890d8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:36.064923 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:36.067155 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:36.089035 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097ac31-9c21-4c8b-9756-0ecd0af5f41d admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:36.164519 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:36.165459 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:36.166043 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:36.166475 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] PATH_INFO: `/v3/projects/8c3f7ba664b4490387323125b7b66e29` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:36.167822 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3f7ba664b4490387323125b7b66e29)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:36.169945 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:36.226862 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3f7ba664b4490387323125b7b66e29', 'request_id': 'req-ca995c9c-6a65-4364-a995-d67e70a4f24c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.234589 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3f7ba664b4490387323125b7b66e29', 'request_id': 'req-ca995c9c-6a65-4364-a995-d67e70a4f24c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.244791 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3f7ba664b4490387323125b7b66e29', 'request_id': 'req-ca995c9c-6a65-4364-a995-d67e70a4f24c'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.257936 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] The token cache is being invalidate because project 8c3f7ba664b4490387323125b7b66e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:36.258444 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.259316 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.261041 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1442/2924] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:36 2022] DELETE /identity/v3/projects/8c3f7ba664b4490387323125b7b66e29 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:36.265655 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:36.267439 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:36.281954 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86549b4-cbe5-4783-8013-1e6872b6a4bc admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:36.370157 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:36.370943 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:36.371287 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:36.371600 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] PATH_INFO: `/v3/users/d95712996adf447e9c9dc5a9c5d1c587` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:36.373071 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95712996adf447e9c9dc5a9c5d1c587)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:36.375324 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:36.434649 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95712996adf447e9c9dc5a9c5d1c587'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.451652 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95712996adf447e9c9dc5a9c5d1c587'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.452445 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95712996adf447e9c9dc5a9c5d1c587'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.453074 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95712996adf447e9c9dc5a9c5d1c587'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.464002 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-6de0746b-f583-4649-869d-40fe870e5e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95712996adf447e9c9dc5a9c5d1c587'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:36.486787 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1483/2925] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:55:36 2022] DELETE /identity/v3/users/d95712996adf447e9c9dc5a9c5d1c587 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:36.836277 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:36.838781 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:36.868290 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca995c9c-6a65-4364-a995-d67e70a4f24c admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:36.922074 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:36.963958 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:36.965194 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:36.965520 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:36.965830 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] PATH_INFO: `/v3/projects/d4c5d1cc96684faa89c827459fda64c3` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:36.967402 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c5d1cc96684faa89c827459fda64c3)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:36.969561 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:37.028921 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c5d1cc96684faa89c827459fda64c3', 'request_id': 'req-c59edc5e-2766-4339-a49c-be0ef5669fa6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:37.036453 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c5d1cc96684faa89c827459fda64c3', 'request_id': 'req-c59edc5e-2766-4339-a49c-be0ef5669fa6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:37.047075 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c5d1cc96684faa89c827459fda64c3', 'request_id': 'req-c59edc5e-2766-4339-a49c-be0ef5669fa6'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:37.059147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] The token cache is being invalidate because project d4c5d1cc96684faa89c827459fda64c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:55:37.059454 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:37.060101 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-c59edc5e-2766-4339-a49c-be0ef5669fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:55:37.061623 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1443/2926] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:55:36 2022] DELETE /identity/v3/projects/d4c5d1cc96684faa89c827459fda64c3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:37.067982 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924d0f-83e6-4c37-95b0-3ca94e503931 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.068264 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924d0f-83e6-4c37-95b0-3ca94e503931 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.068535 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924d0f-83e6-4c37-95b0-3ca94e503931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.091904 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-24924d0f-83e6-4c37-95b0-3ca94e503931 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:37.093228 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-24924d0f-83e6-4c37-95b0-3ca94e503931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:37.116047 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:37.167834 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1484/2927] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:37.176292 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731bc42-fca1-4e3e-a8f4-dd9cbda2aa30 None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.176885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731bc42-fca1-4e3e-a8f4-dd9cbda2aa30 None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.176885 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731bc42-fca1-4e3e-a8f4-dd9cbda2aa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.199252 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-8731bc42-fca1-4e3e-a8f4-dd9cbda2aa30 None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:37.200491 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-8731bc42-fca1-4e3e-a8f4-dd9cbda2aa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:37.208722 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1444/2928] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:37.213524 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24924d0f-83e6-4c37-95b0-3ca94e503931 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:37.225644 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24924d0f-83e6-4c37-95b0-3ca94e503931 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:37.232404 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:37.233265 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.233656 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.234105 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.234958 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81722) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 14:55:37.235379 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:37.237748 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:37.253782 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1485/2929] 10.222.0.49 () {58 vars in 1153 bytes} [Tue Aug 30 14:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 14:55:37.259556 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731bc42-fca1-4e3e-a8f4-dd9cbda2aa30 None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:37.272655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731bc42-fca1-4e3e-a8f4-dd9cbda2aa30 None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:37.279178 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dec8e-3f9b-4954-8344-952622d4c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:37.280227 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dec8e-3f9b-4954-8344-952622d4c1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.280752 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dec8e-3f9b-4954-8344-952622d4c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.281221 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dec8e-3f9b-4954-8344-952622d4c1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.282167 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dec8e-3f9b-4954-8344-952622d4c1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:37.284267 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dec8e-3f9b-4954-8344-952622d4c1a0 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:37.317283 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1445/2930] 10.222.0.49 () {60 vars in 1153 bytes} [Tue Aug 30 14:55:37 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:37.323607 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:37.334968 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53799-a585-4591-ae07-df99392db9fe admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:37.408053 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b83733-3afe-427b-b6d5-5e60c491ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:37.408817 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83733-3afe-427b-b6d5-5e60c491ed45 admin admin] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.409315 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83733-3afe-427b-b6d5-5e60c491ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.409604 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83733-3afe-427b-b6d5-5e60c491ed45 admin admin] PATH_INFO: `/v3/users` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.410364 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b83733-3afe-427b-b6d5-5e60c491ed45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:37.412448 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b83733-3afe-427b-b6d5-5e60c491ed45 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:37.440338 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1486/2931] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Aug 30 14:55:37 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 14:55:37.446053 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dec8e-3f9b-4954-8344-952622d4c1a0 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:37.457828 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dec8e-3f9b-4954-8344-952622d4c1a0 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:37.463344 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a1ff-073d-4ef1-9010-12aef4211b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:37.463975 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a1ff-073d-4ef1-9010-12aef4211b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.464259 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a1ff-073d-4ef1-9010-12aef4211b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.464527 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a1ff-073d-4ef1-9010-12aef4211b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.465176 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a1ff-073d-4ef1-9010-12aef4211b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:37.466854 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a1ff-073d-4ef1-9010-12aef4211b7f admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:37.479044 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1446/2932] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:37.483215 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b83733-3afe-427b-b6d5-5e60c491ed45 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:37.493913 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b83733-3afe-427b-b6d5-5e60c491ed45 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:37.499257 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f01259-c59a-4b80-89ae-9debeddaba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:37.500135 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f01259-c59a-4b80-89ae-9debeddaba84 admin admin] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.500594 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f01259-c59a-4b80-89ae-9debeddaba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.501022 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f01259-c59a-4b80-89ae-9debeddaba84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.502003 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f01259-c59a-4b80-89ae-9debeddaba84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:37.504626 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f01259-c59a-4b80-89ae-9debeddaba84 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:37.519721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1487/2933] 10.222.0.49 () {58 vars in 1122 bytes} [Tue Aug 30 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 14:55:37.524333 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a1ff-073d-4ef1-9010-12aef4211b7f admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:37.535554 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a1ff-073d-4ef1-9010-12aef4211b7f admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:37.541925 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:37.542634 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.542909 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.543181 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] PATH_INFO: `/v3/projects/c8098e438ac442b1b2ab58905759c32c/users/7ff242b952e74693aeed24adff9132a3/roles/2284ec91b47444249d339c70801cd407` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.560003 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8098e438ac442b1b2ab58905759c32c, user_id=7ff242b952e74693aeed24adff9132a3, role_id=2284ec91b47444249d339c70801cd407)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:37.562730 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:37.579109 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1447/2934] 10.222.0.49 () {60 vars in 1483 bytes} [Tue Aug 30 14:55:37 2022] PUT /identity/v3/projects/c8098e438ac442b1b2ab58905759c32c/users/7ff242b952e74693aeed24adff9132a3/roles/2284ec91b47444249d339c70801cd407 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:55:37.592038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013f17-7de2-4554-a6d2-2ef65d3254c4 None None] REQUEST_METHOD: `POST` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.592420 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013f17-7de2-4554-a6d2-2ef65d3254c4 None None] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.592758 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013f17-7de2-4554-a6d2-2ef65d3254c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.626038 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.auth.core [None req-60013f17-7de2-4554-a6d2-2ef65d3254c4 None None] MFA Rules not processed for user `7ff242b952e74693aeed24adff9132a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81722) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:55:37.627303 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-60013f17-7de2-4554-a6d2-2ef65d3254c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:37.711104 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1488/2935] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:55:37.723724 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:55:37.726503 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:55:37.809323 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375774-084f-4c65-ac9d-29c6f247b292 admin admin] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:55:37.814296 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63a47d-b399-494e-9392-896c00752f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a725ee4d8b0b4524ad8484c3255f75da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:55:37.814999 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63a47d-b399-494e-9392-896c00752f9c service cinder] REQUEST_METHOD: `GET` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:55:37.815378 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63a47d-b399-494e-9392-896c00752f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:55:37.815841 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63a47d-b399-494e-9392-896c00752f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:55:37.829455 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63a47d-b399-494e-9392-896c00752f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:55:37.831655 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63a47d-b399-494e-9392-896c00752f9c service cinder] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:55:37.842891 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1448/2936] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:55:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:55:47.707164 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:47.838152 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:08.634942 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60013f17-7de2-4554-a6d2-2ef65d3254c4 None None] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:08.706793 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60013f17-7de2-4554-a6d2-2ef65d3254c4 None None] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:08.712035 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:08.712700 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.712977 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.713297 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] PATH_INFO: `/v3/users/7ff242b952e74693aeed24adff9132a3` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.714541 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff242b952e74693aeed24adff9132a3)` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:08.716523 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:08.781751 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff242b952e74693aeed24adff9132a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.796162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff242b952e74693aeed24adff9132a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.797176 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff242b952e74693aeed24adff9132a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.797899 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff242b952e74693aeed24adff9132a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.807808 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.notifications [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff242b952e74693aeed24adff9132a3'} {{(pid=81722) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:08.821171 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1489/2937] 10.222.0.49 () {58 vars in 1224 bytes} [Tue Aug 30 14:56:08 2022] DELETE /identity/v3/users/7ff242b952e74693aeed24adff9132a3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:08.826195 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974b43b-11fa-4843-8b65-60a287ab58be None None] REQUEST_METHOD: `POST` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.826762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974b43b-11fa-4843-8b65-60a287ab58be None None] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.826762 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974b43b-11fa-4843-8b65-60a287ab58be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:08.847096 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.auth.core [None req-e974b43b-11fa-4843-8b65-60a287ab58be None None] MFA Rules not processed for user `43c4bb62b38b4ecb87897eea003a764f`. Rule list: `[]` (Enabled: `True`). {{(pid=81723) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 14:56:08.848321 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e974b43b-11fa-4843-8b65-60a287ab58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:08.913926 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1449/2938] 10.222.0.49 () {58 vars in 958 bytes} [Tue Aug 30 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 14:56:08.924330 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:08.926041 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:08.994771 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1755d7e-74d2-478d-b843-37586459ddf5 admin admin] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:08.998710 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b24f12951bd4220afad25f23f566f6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:08.999351 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:08.999625 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:08.999898 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:09.010791 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:09.012250 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:09.023725 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1490/2939] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:56:09.357608 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974b43b-11fa-4843-8b65-60a287ab58be None None] Authenticating user token {{(pid=81723) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:56:09.360025 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.fernet_utils [None req-e974b43b-11fa-4843-8b65-60a287ab58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81723) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:56:09.374583 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974b43b-11fa-4843-8b65-60a287ab58be None None] Validating token access rules against request {{(pid=81723) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:56:09.380002 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c4bb62b38b4ecb87897eea003a764f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '259468708afd445bab53811821f0bda0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81723) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:56:09.380656 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:56:09.380978 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:56:09.381184 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] PATH_INFO: `/v3/projects/c8098e438ac442b1b2ab58905759c32c` {{(pid=81723) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:56:09.382441 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8098e438ac442b1b2ab58905759c32c)` {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:56:09.384497 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] RBAC: Authorization granted {{(pid=81723) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:56:09.443930 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8098e438ac442b1b2ab58905759c32c', 'request_id': 'req-f514185f-9d84-4f16-b0a7-e27f4b3520ee'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.451089 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8098e438ac442b1b2ab58905759c32c', 'request_id': 'req-f514185f-9d84-4f16-b0a7-e27f4b3520ee'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.460147 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8098e438ac442b1b2ab58905759c32c', 'request_id': 'req-f514185f-9d84-4f16-b0a7-e27f4b3520ee'} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.472192 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] The token cache is being invalidate because project c8098e438ac442b1b2ab58905759c32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81723) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 14:56:09.472514 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.473180 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG keystone.notifications [None req-f514185f-9d84-4f16-b0a7-e27f4b3520ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81723) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 14:56:09.474763 dv-cinder-828805-5-smb devstack@keystone.service[81723]: [pid: 81723|app: 0|req: 1450/2940] 10.222.0.49 () {58 vars in 1233 bytes} [Tue Aug 30 14:56:09 2022] DELETE /identity/v3/projects/c8098e438ac442b1b2ab58905759c32c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 14:56:19.018813 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:19.468846 dv-cinder-828805-5-smb devstack@keystone.service[81723]: DEBUG dbcounter [-] [81723] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:06.256359 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] Authenticating user token {{(pid=81722) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 14:57:06.258039 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:06.335238 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44646aa3-69ca-4883-aedf-8dc1b62ef9f0 service neutron] Validating token access rules against request {{(pid=81722) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 14:57:06.395650 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fa835-f092-4144-b5df-2afca2ee4b0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e595269cd746d68edd59783c1d6314', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabb84470909411f80adffac902dea45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81722) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 14:57:06.396162 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa835-f092-4144-b5df-2afca2ee4b0a service placement] REQUEST_METHOD: `GET` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 14:57:06.396434 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa835-f092-4144-b5df-2afca2ee4b0a service placement] SCRIPT_NAME: `/identity` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 14:57:06.396721 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa835-f092-4144-b5df-2afca2ee4b0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81722) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 14:57:06.398454 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.fernet_utils [None req-f25fa835-f092-4144-b5df-2afca2ee4b0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81722) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 14:57:06.411409 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fa835-f092-4144-b5df-2afca2ee4b0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 14:57:06.413418 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fa835-f092-4144-b5df-2afca2ee4b0a service placement] RBAC: Authorization granted {{(pid=81722) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 14:57:06.424932 dv-cinder-828805-5-smb devstack@keystone.service[81722]: [pid: 81722|app: 0|req: 1491/2941] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Aug 30 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 14:57:16.420223 dv-cinder-828805-5-smb devstack@keystone.service[81722]: DEBUG dbcounter [-] [81722] Writing DB stats keystone:SELECT=58 {{(pid=81722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}